His self-portraits hang in the National Portrait Gallery and Tate Britain.
A commemorative blue plaque to him hangs outside the Whitechapel Gallery, formerly the Whitechapel Library, which was unveiled by Anglo-Jewish writer Emanuel Litvinoff.
On 11 November 1985, Rosenberg was among 16 Great War poets commemorated on a slate stone unveiled in Westminster Abbey's Poet's Corner. The inscription on the stone was written by a fellow Great War poet, Wilfred Owen. It reads: "My subject is War, and the pity of War. The Poetry is in the pity."
Rosenberg appears in the novel Grosse Fugue by Ian Phillips.
In The Great War and Modern Memory, Paul Fussell's landmark study of the literature of the First World War, Fussell identifies Rosenberg's "Break of Day in the Trenches" as "the greatest poem of the war."