White played college football at Tennessee from 1980 to 1983, where he set school records for most sacks in a career, season and game. He still holds these records. While playing for the Volunteers, White was named an All-American.