Mr. Tansley tells James that there’s no way they can go to the Lighthouse, but he softens his tone, out of respect for his beloved Mrs. Ramsay.
Mrs. Ramsay thinks to herself that Mr. Tansley is an awful man to keep bringing that up. She actually calls him an "odious little man," which is a pretty good insult.