That's right! Found completely by accident!
It's by a band called Veruca Salt, and is actually a really brilliant song
"My heart skips around
When I hear the sound
I'm never alone
Cause you're following me home
I'm falling in love
My walkman and me
With David Bowie."
Link to the song on youtube: https://www.youtube.com/watch?v=ZZFWj1muips