why does Henry envy the infantrymen?

The infantry men have rifles, and Henry does not. He sees their actions as heroic and wishes he could be a part of it. None-the-less, he doesn't get a rifle and has no wish to return to his own regiment. They might figure out that he'd run.