Answer
The atom does not end up moving very fast.
Work Step by Step
Momentum is conserved, but as the atom is relatively massive, when it emits a photon, the atom doesn’t end up moving very fast, so its recoil energy is usually neglected.
The fact that recoil energy does exist was proven by a famous experiment known as the Mossbauer effect.