Melville took to the lecture circuit, which, for writers like Ralph Waldo Emerson, was a lucrative practice. Melville, though, was never really able to make a go of it. Those who had any interest in him at all came to hear about Typee and Omoo, not his later books. Melville lectured for three years before quitting the circuit. In 1863, he was forced to sell Arrowhead to his brother, and he moved his family back to New York City. In 1866, he took a job as a customs inspector at the New York Custom House, a desk job that paid just $4 a day. He worked there for the next twenty years.
Though he could no longer write full time, Melville never permanently put away the pen. He turned his interests to poetry instead. Melville had been deeply affected by the Civil War, especially by an 1864 visit to the front lines with his brother. In 1866, he published a book of verse entitled Battle-Pieces and Aspects of the War. He was also laboring on an epic poem entitled Clarel, a project his wife called a "dreadful incubus"
In addition to his professional failure, Melville's personal life was rocked by tragedy. In 1867, his eldest son Malcolm killed himself in what was either an accidental shooting or intentional suicide. In 1886, the year Melville retired from the custom house, his other son Stanwix died of tuberculosis. Yet, despite these challenges, and the fact that his career seemed to have bottomed out completely, Melville was not a tormented man. When not at work, he spent most of his time at home, playing with his grandchildren and working on writing projects which he had no intention of publishing. He read voraciously. Friends visited - sometimes.