These lovers go way, way back. They were practically in diapers when they first met. Well, at least the speaker's lover was still riding a toy bamboo horse, which suggests that he was pretty little. The point is, the speaker's evocation of meeting her sweetheart in childhood gives us a sense of how deep their relationship—and their love—is. It has its roots way back in their childhood.