What/who exactly is the antagonist in the story?

The banks play the role of antagonist. Poor crops and the farmers' inability to pay the banks leads them to throw tenant farmers off their land. This is the reason the Joads left for California to start a new life.