Answer
Yes.
Work Step by Step
A fish traveling faster than water waves would indeed be supersonic, and produce a "sonic boom".
The explanations for a supersonic object creating a sonic boom in air are equally applicable when the medium is water.