Er ist verheiratet mit Martha Noyes.
Sie haben geheiratet rund 1826 in Connecticut probably.
1. Henry and Martha, on their return from China to New York City, during the War of the Rebellion (Civil War), were captured by the rebel privateer Shenandoah, and many of their works of art and curious were plundered and destroyed; they were afterward awarded damages from the "Alabama Fund". Martha published a very account of their experience.