It has been common for Supreme Court Justices to officiate weddings in the past, but Kaiser and Roberts' wedding is the first same-sex marriage to be performed by a member of the court.
The Washington Post reports that Ginsberg, an avid arts supporter, and Kaiser are close friends. Among the invited guests are Ron Raines and Barbara Cook, as well as Renee Fleming and Harolyn Blackwell.
"I think it will be one more statement that people who love each other and want to live together should be able to enjoy the blessings and the strife in the marriage relationship," Ginsberg said.
The 80-year-old Ginsburg, now in her 20th year on the court, was a supporter of the court's landmark decisions earlier this summer, which struck down a key part of the Defense of Marriage Act, allowing same-sex couples the same federal rights as heterosexual couples, as well as leaving in place a lower court's ruling that Proposition 8, a California ban on gay marriage, was unconstitutional and unfairly discriminated against gay couples.
"Today's ruling provides certainty and clear, coherent tax filing guidance for all legally married same-sex couples nationwide. It provides access to benefits, responsibilities and protections under federal tax law that all Americans deserve," said Secretary Jacob J. Lew in a statement. "This ruling also assures legally married same-sex couples that they can move freely throughout the country knowing that their federal filing status will not change."