"You are always attracting crowds without intending to do so."

She watches him fall, and for a fraction of a moment, looks worried. When the Doctor springs back up, she's annoyed at her concern. "It's not an effective duel if you make so much noise. The swords are not meant to hit each other."

In other words, try hitting the opponent, instead of gaining an audience by clanging swords.