Answers 1Add Yours
I think there is some pride there. He was angry because things could have gotten dangerous for Jem, Scout and Dill. We later see his anger is tempered by Scout's intervening with the innocence of a child. Jem's steadfastness in not leaving actually helped the situation.