In 1954 Walcott married Fay Moston, a secretary, and they had a son, the St. Lucian painter Peter Walcott. The marriage ended in divorce in 1959. Walcott married a second time to Margaret Maillard in 1962, who worked as an almoner in a hospital. Together they had two daughters, Elizabeth Walcott-Hackshaw and Anna Walcott-Hardy, before divorcing in 1976.[38] In 1976, Walcott married for a third time, to actress Norline Metivier; they divorced in 1993. His companion until his death was Sigrid Nama, a former art gallery owner.[14][39][40][41]
Walcott was also known for his passion for travelling to countries around the world. He split his time between New York, Boston, and St. Lucia, and incorporated the influences of different locations into his pieces of work.[2]