Country music artist Ty Herndon wants LeAnn Rimes to sing at his wedding.

The 52-year-old Herndon came out gay late last month in an interview with PEOPLE.

On Sunday, he made his first public appearance with partner of five years Matt Collum, a pharmaceutical representative from Missouri. The pair walked the red carpet holding hands at TrevorLIVE in Los Angeles.

Herndon told PEOPLE that he and Collum talk about marriage “a lot.”

“But I have a new album,” he added. “When we have time. I know that's weird to say, but I'm so busy!”

In a separate interview with gay weekly The GA Voice, Herndon said that he has picked out his wedding song.

“There's a Rascal Flatts song that I referred to, God Bless The Broken Road That Has Led Me Straight To You. That would be our wedding song. And if I had my wish, I would have my friend LeAnn Rimes come and sing it,” he said.

(Related: LeAnn Rimes “super proud” of Ty Herndon, Billy Gilman.)