He star'd at the Pacific—and all his menLook'd at each other with a wild surmise—(12-13)
The explorer is staring at the Pacific, but all the men are down the mountain just staring at one another. A leader is way out on the frontier. They see things firsthand and have the difficult task of trying to communicate that experience. That's what Keats sees as the poet's struggle.