Why are so many people apparently suspicious of George and Lennie's friendship?

Why are so many people apparently suspicious of George and Lennie's friendship?