Neil Diamond has said "Sweet Caroline" was inspired by a photo of a 4-year-old Caroline Kennedy ... hence the awkward laughter when Caroline recited the line, "touching me, touching you" back at the singer during the Kennedy Center Honors event last night.