What does Walter mean by, "Damn even the N double A C P takes a holiday sometimes?"

The National Association for the Advancement of Colored People is an organization that fghts for the rights of blacks in America. Walter is joking that he somehow works hard at the ideals of this group.