Johnson initially played drums and piano before switching to tenor saxophone.[4] In the 1920s, he performed in Texas and parts of the Midwest, working with Jesse Stone among others.[4] Johnson had his recording debut while working with Louis Armstrong's band in 1932 to 1933, but he is more known for his work, over many years, with Earl Hines.[4] It is contended that he and Billy Eckstine, Hines' long-term collaborator, led Hines to hire "modernists" in the birth of bebop, which came largely out of the Hines band. Johnson was also an early figure in the bebop era, doing sessions with Coleman Hawkins in 1944. Johnson was a key figure in the first bebop group on 52nd Street in NYC, which played at the Onyx Club (1944) and featured Johnson, Dizzy Gillespie, George Wallington (pn), Oscar Pettiford (bs) and Max Roach (drs). Johnson urged Gillespie to write out his melodic ideas for 2 horns (trumpet and saxophone) to play in unison, a sound which became the signature style of small-group bebop. In the 1950s he led his own group,[4] and did session work for Atlantic Records – he is the featured tenor saxophone soloist on Ruth Brown's hit "Teardrops from My Eyes". In the mid-1960s, he began working and recording again with Hines.[4] His association with Hines is his longest lasting and most significant. In 1975, he began working with the New York Jazz Repertory Orchestra.[4] He was inducted into the Big Band and Jazz Hall of Fame in 1993. His grandson, Albert Johnson (aka Prodigy), was a member of the hip-hop duo Mobb Deep.[5]
He died of a heart attack in Kansas City at the age of 73.[6]