Born in Montreal, Brott studied at the McGill Conservatory and the Juilliard School, and would have attended the Royal Academy of Music in London had World War II not interrupted his education.

His first orchestral work, Oracle was performed in 1939. Brott joined the Montreal Symphony Orchestra and became a member of the faculty of McGill University, where he remained until 1980 as professor, conductor in residence, and head of the orchestral instruments department.

Brott's most recent work, My Mother, My Memorial was performed in February by Southern California's New West Symphony, conducted by his son, Boris.