Answer
Yes, it exerts a force of equal magnitude.
Work Step by Step
Newton's third law. If the magnet exerts a force on the paper clip, we find that the paper clip exerts an equal and opposite force on the magnet.
This is discussed on page 76.