Your two penn'orth?
Yes and yes. That's pretty complete. I'll give you the rest.
Hunky Dory - Kooks, by David Bowie about Zowie (now film director Dylan Jones)
Unrequited - Rufus Is A Tit Man, by Loudon Wainwright III about Rufus (obv), missing the point hilariously
Dream of Life - The Jackson Song, by Patti Smith about her son Jackson, now married to Meg White of the White Stripes
the other side of Revolution is Hey Jude, which wasn't an album track
, written about Julian Lennon (originally Hey Jules) by Paul McCartney.
So yes, Hey Jude is the odd one out, because it's not about the artist's own child, but that of a colleague.
Although I would have accepted Zowie Bowie as the odd one out, as he isn't a musician.