What about the threats to Jeanne and her brother are the most threatening?

From the text:

"It was the threat that frightened us, their fearful looks, and the noises they would make, like miniature Samurai, in a language we couldn't understand."