Kristin Chenoweth and Idina Menzel, who both recently released new solo recordings, will be guests on Jimmy Kimmel Live! this week. Chenoweth will appear on the October 4 broadcast, while Menzel will be a guest October 5.

Jimmy Kimmel Live! airs weeknights at 11:35 PM ET on ABC; check local listings.

Guests for the upcoming week follow:
October 3: Dolly Parton, Ella Purnell
October 4: Billy Bob Thornton, Kristin Chenoweth, Ryan Donahue
October 5: Zach Galifianakis, Idina Menzel
October 6: Martin Lawrence, Gary Clark Jr.

The new recording from Chenoweth, who will return to Broadway this November with a solo concert at the Lunt-Fontanne Theatre, is entitled The Art of Elegance and is available on the Concord Records label.

The complete track listing for the album follows:

“Someone to Watch Over Me”
“I've Got a Crush on You” (feat. Dave Koz)
“Let's Fall In Love”
“Bewitched, Bothered and Bewildered”
“Zing! Went the Strings of My Heart”
“The Very Thought of You” (feat. Dave Koz)
“They Can't Take That Away From Me”
“A House Is Not a Home”
“I Get Along Without You Very Well”
“Skylark”
“I'm a Fool to Want You”
“Smile”
“You're My Saving Grace...”

Menzel's latest solo outing, idina, is available from Warner Bros. Records. The actress previously said the CD is “the most personal, introspective album I’ve made.”

Watch a music video for one of the recording's tracks, “Queen of Swords,” below:

The complete track listing follows:
“Small World”
“Like Lightning”
“Queen of Swords”
“I See You”
“Everybody Knows”
“Show Me”
“Last Time”
“I Do”
“Cake”
“Extraordinary”
“Perfect Story”
“Nothin’ in This World”