He is married to Mary Elizabeth Borden.
They got married on April 11, 1861 at Angelina County, Texas, Verenigde Staten .Source 2
Information in some trees have him dying in 1878 in New Orleans. This may be true as there was a Joseph Clayton age 38 who is listed in the newspaper as having died 21 Sep 1878 at the hospital from yellow fever. I have attached a copy of the newspaper article to his profile.