In First Aid Kit's song "To A Poet", there is the lyric, "But Frank put it best when he said "you can't plan on the heart"", a reference to Frank O'Hara's poem, My Heart.
In the 2011 film Beastly, the lovestruck main characters read O'Hara's poem "Having a Coke with You" aloud to each other.
O'Hara is a minor character in William Boyd's 2002 novel Any Human Heart.
In the season 1 episode of the HBO series Bored to Death, "The Case of the Missing Screenplay", the main character loses a screenplay written by Jim Jarmusch about the life of Frank O'Hara.
Several episodes of Mad Men (season 2) reference O’Hara’s collection of poetry, Meditations in an Emergency. The first episode shows a character reading from it over lunch in a bar (recalling O'Hara's 1964 collection Lunch Poems) as does the last episode, which uses the book's title as its episode title. In the twelfth episode, Don Draper finds his copy of Meditations in an Emergency in Anna Draper's home in California.
On June 10, 2014, a plaque was unveiled outside one of O'Hara's New York City residences, at 441 East Ninth Street. Poets Tony Towle, who inherited the apartment from O'Hara, and Edmund Berrigan read his works at the event.