Why has Dunny kept the stone all these years?

I think it is a reminder of the past: of his fateful mistake (throwing it) and the responsibility that Boy never undertook. Dinstan says that "I kept it because I could never part with it."