Glory
When Marcus Aurelius asked Maximus to fight "for the glory of Rome," nobody thought he was asking his favorite general to do Rome's banking paperwork for eleven hours a day, six days a week. Yes, you may be helping people find the right loan, but gravediggers help move dirt out of the way by digging, and Apple helps you purchase a $600 phone by providing you with an easy-to-use checkout system. Not exactly pulling victims out of earthquake rubble, is it?
But just because you're not going to feel super good about yourself due to your work doesn't mean you should feel bad about yourself at all. You provide a service, and one which people obviously need, otherwise mortgage brokers wouldn't be in business. You're there to do a task, make money, and enjoy a hard earned home of your own. Nothing wrong with that.