Herman Frazier was a two-time All-American and six-time Ohio Athletic Conference champion in track and field. He earned All-American status at the 1973 national tournament with his performance in the 440-yard dash. He was also received All-American honors as a member of the 4x110 relay team.
After one season, Frazier transferred to Arizona State University where he became an All-American sprinter for the Sun Devils. He was the team captain of the 1977 national champion track team at ASU, and graduated that same year with a degree in political science.
Frazier also served as a member of the U.S. National Track & Field team. During that time he participated both in the Olympic and Pan-American games. In the 1976 Montreal Olympics, he ran the first leg for the gold medal-winning 4x400 relay team. Individually, he won a bronze medal in the 400-meter dash. Frazier was also a gold medalist at both the 1975 and 1979 Pan-American Games.
Frazier began his administrative career as a graduate assistant at Arizona State University in 1977. He later became a full-time administrator and remained with the university for 23 years, eventually becoming the Senior Associate Athletic Director. Frazier earned his first athletic director job at the University of Alabama at Birmingham in 2000. In 2002, he left UAB to accept the athletic director position at the University of Hawaii where he would remain until 2008.
In 2003, Frazier was cited as one of the 101 Most Influential Minorities in Sports by Sports Illustrated. He was also named one of The 50 Most Powerful African Americans in Sports in the March 2005 issue of Black Enterprise magazine.