Answer
Yes, bleaching hair to change it into a different color is a chemical reaction.
Work Step by Step
Since there is a obvious color change which is one of the first signs of a chemical reaction, it is certainly a chemical change and not simply a physical change.