How is Ender’s small troop able to beat the older boys in the Battle Room?

Are you referring to when the older boys surround them? The remaining Launchies in training are confronted by the older boys, which starts a fight in the battleroom. Ender's hand-to-hand combat training helps him do well in the fight.