What is troublesome about Paris' line "for now my ministry's at stake, my ministry and perhaps your cousin's life"?

The most troublesome thing for Parris is the thought that his job and economic status might possibly be in danger. Thoughts for his daughter's well-being, obviously take a back seat.