Why do you think George stresses the idea that because they have a dream, they are different from the other lonely men?

Having the dream is just part of what George thinks is special. The fact that they travel together and "give a damn" about each other separates them fro the other men who are alone. The farm is the culmination of their dream, a final place of belonging.