The principal setting of four of the Mapp and Lucia books is a town named Tilling, which is recognizably based on Rye, East Sussex, where Benson lived from 1918 and served as mayor from 1934. Benson's home, Lamb House, served as the model for Mallards, Mapp's – and ultimately Lucia's – home in some of the Tilling series. There really was a handsome "Garden Room" adjoining the street but it was destroyed by a bomb during the Second World War.[6] Lamb House attracted writers: it was earlier the home of Henry James, and later of Rumer Godden.
He donated a church window of the main parish church in Rye, St Mary's, in memory of his brother, as well as providing a gift of a viewing platform overlooking the Town Salts.[7]