MTV reports that the girl group Fifth Harmony and previous winner Sam Bailey will also appear on the upcoming episode, along with a mystery guest.
Menzel, who currently stars in Broadway's If/Then, is a Tony Award winner for her performance in Wicked. She has also appeared in Rent and Aida.
Menzel voiced the character of Elsa in the award-winning animated film "Frozen" and sang its Academy Award-winning song "Let It Go." Her new album, "Holiday Wishes," was recently released.