Why do the pearl fishers still go to the dealers even though they are being cheated by them?

The fisherman did not know that the pearl buyers all worked for one man... that it was all settled between them before it began.

It was supposed that the pearl buyers were individuals acting alone, bidding against one another for the pearls the fishermen brought in.