This house at Rich's Cove was originally built near Old Cove by Robert Douglas in the early 19th century. It was moved from there to Rich's Cove by way of carts and oxen and also by barge on the water. The original foundation is still visible near the road to Rich's Point.

Douglas sold the house to John Rich in 1844, and so began the long history of the Rich family making their homes at the cove. The last of the Rich family to live at this cove was Miss Ava, who passed away in 1970. Her sister Elizabeth (Miss Lizzie) survived her, and was the island's postmistress until 1988.