It was previously reported that the mother and daughter will duet on "Ohio"; "Sway" and "Marry You" are among the other songs set to be featured.
The guest appearance of Emmy winner and Tony nominee Burnett ("The Carol Burnett Show," Once Upon a Mattress, Moon Over Buffalo) will likely bring strong ratings for "Glee," as Gwyneth Paltrow did for the Nov. 16 episode, "The Substitute."
The episode that featured Oscar winner Paltrow as substitute teacher Holly Holliday brought in 11.6 million viewers and a 4.9 rating in the 18-49 demographic, according to the Hollywood Reporter.
"Glee" airs Tuesdays at 8 PM ET on Fox.