According to Simon, "[my abilities as a guitarist] hadn't kept up with the melodies and chord structures I could think of. What I discovered while making Graceland was a deeper understanding of rhythm....The big learning experience from the African musicians, and especially the guitarists, was how do I break down rhythm and understand its workings, what its effects are derived from, how might I reproduce them, instead of writing something and thinking, 'That's a good groove. I hope I get another one.'"
Writing and composing the songs for Graceland was largely a collaborative effort between Paul Simon and the South African guitarist Ray Phiri, bassist Bakithi Khumalo, and Zulu a capella group Ladysmith Black Mambazo. Together, these musicians find the groove on "You Can Call Me Al" from the very start of the song, when the keyboards, drums, trumpet, and saxophone all kick in. According to the bassist Bakithi Khumalo, when composing the music for the songs, he had to make space for Simon's lyrics. In a profile of Paul Simon in the New Yorker, Alec Wilkinson explains that "as a singer, Simon is an adept and imaginative phraser, an ability he developed to compensate, he says, 'for not having a big voice.'" You can hear this unique vocal delivery in the very first verse, as Simon allows the words to fill their own space rather than unwittingly forcing them out.
The musical scholar Louis Meintjes explains that on "You Can Call Me Al," "distinct musical styles are structurally integrated rather than merely juxtaposed." This is most prominently highlighted during the song's instrumental breakdown, which features the pennywhistle and the bass. The pennywhistle solo pays homage to a South African musical genre called kwela, which was an improvisational street music prominent in the black townships during the 1950s and 1960s. The song also contains elements of the Zulu choral music called mbube. Together, mbube and kwela create a musical sound that was prominent in South Africa in the 1980s called mbaqanga, or township jive. These distinct South African musical styles combine with Paul Simon's vocals, delivered in English, to create a distinctive, worldly sound.