Why couldn’t the driver return to his childhood home?

The driver couldn't return to his childhood home because it no longer existed. His home was lost when his parents we killed in a car accident.

“Nope. I didn’t have no home to go back to, like you do. The road was my only home. Lost my ma and pa when I was a little shaver. Killed in a car wreck.”