His first appointment was as music director of the American Symphony Orchestra in Paris, when he was 19. He conducted all over the United States and Europe, including the Royal Philharmonic Orchestra in London, the St. Cecilia Orchestra in Rome, and the Boston Symphony's Berkshire Orchestra. He was, before moving to Washington DC in 1972, the music director of Virginia's Lynchburg Symphony.
Yarborough retired in 1996.