So I said, "The thing that you are doing is not good. Should you not walk in the fear of our God, to prevent the taunts of the nations our enemies? Moreover I and my brothers and my servants are lending them money and grain. Let us stop this taking of interest. Restore to them, this very day, their fields, their vineyards, their olive orchards, and their houses, and the interest on money, grain, wine, and oil that you have been exacting from them." Then they said, "We will restore everything and demand nothing more from them. We will do as you say." And I called the priests, and made them take an oath to do as they had promised. (NRSV Nehemiah 5:9-12)
Also I said, It is not good that ye do: ought ye not to walk in the fear of our God because of the reproach of the heathen our enemies? I likewise, and my brethren, and my servants, might exact of them money and corn: I pray you, let us leave off this usury. Restore, I pray you, to them, even this day, their lands, their vineyards, their oliveyards, and their houses, also the hundredth part of the money, and of the corn, the wine, and the oil, that ye exact of them. Then said they, We will restore them, and will require nothing of them; so will we do as thou sayest. Then I called the priests, and took an oath of them, that they should do according to this promise. (KJV Nehemiah 5:9-12)
Nehemiah sees that this "predatory lending" can potentially shatter the social order. The people need to pull in the same direction and can't be divided internally like this. BTW, this is one of the only times that Nehemiah admits he does something wrong. He admits that he has also been involved in these burdensome loans.