Hij is getrouwd met Martha Noyes.
Zij zijn getrouwd rond 1826 te Connecticut probably.
1. Henry and Martha, on their return from China to New York City, during the War of the Rebellion (Civil War), were captured by the rebel privateer Shenandoah, and many of their works of art and curious were plundered and destroyed; they were afterward awarded damages from the "Alabama Fund". Martha published a very account of their experience.