"Odd thought, the man dancing. I could sooner enchant the trees into frolicking about." He thinks this is about Norrell.

"So many magicians. I shouldn't be surprised to see that little man with his yellowed curtain raving at us all." He doesn't sound like he would actually mind all that much. It wouldn't be his party the man was disrupting.