Chenoweth chatted with Leno about her new country-pop album entitled "Some Lessons Learned," due Sept. 13 on the Sony Masterworks label. She also shared stories about singing for President Obama and performing on Broadway.
Colfer talked about returning to the halls of McKinley High when the third season of "Glee" comes back to Fox Sept. 20.
The two multi-talented performers also discussed when they filmed "Glee" together and gave Leno the inside scoop on what happened when the camera wasn't rolling.
The musical-theatre "Tonight Show" episode concluded with a performance from Chenoweth. The actress sang "Fathers and Daughters" off of her new album.
To watch "The Tonight Show With Jay Leno," look below: