Author Horatio Colony (1900-1977) was raised in a family of successful mill owners whose history in Keene dates back to 1761. His four-square Federal style family home at 199 Main Street was built in 1806 by the Blake family. In the early 1830's the house was sold to Elias Joslin, a well-respected blacksmith. Elias and his wife Maria Emes Joslin left the house to their only child, Emeline. Emeline married Horatio Colony, the youngest son of Josiah Colony who co-founded the woolen mill in Keene with Francis Faulkner.

Horatio inherited the Colony portion of the mill business and also became Keene's first mayor when it became a city in 1874. Emeline and Horatio had three children, John, Charles and Kate.

In 1899 Emeline had renovations done to the house, which included installing beautifully patterned ceilings, honey colored oak floors, and hand painted tiles in various fireplaces. Emeline gave the house at 199 Main Street to their son Charles after his marriage to Ellen Warren that same year.

Charles worked with his father and brother in the mill business. Ellen and Charles had one child, naming him Horatio after Charles' father. Horatio the younger attended public schools in Keene, Philips Exeter Academy and Harvard. After graduating from college, he traveled abroad. Returning home, Horatio worked in the family business, both at the mill in Keene and at the family owned mill in Harrisville, New Hampshire.

Writing was a passion from an early age for Horatio. He wrote his first play, William Penn's Peace Treaty with the Indians, in seventh grade. Around this time his mother encouraged him to keep a diary, which he continued throughout his life. Perhaps this helped in the development of his literary talents. His first novel, Free Forester, gained notoriety when published in 1935. From that year until 1972, he published eleven volumes of verse and a two-volume set of collected writings.

Horatio and his wife Mary Curtis traveled the world. Items purchased during their travels adorn their home, along with heirlooms inherited from both Horatio and Mary's Families.

The furnishings span from early 18th through late 19th centuries, giving the house a warm, eclectic look. This forms a rich back-drop for antique oriental rugs, family portraits, landscape paintings, tall clocks, high boys, writing desks replete with collections of elegant writing accouterments, and far more to delight the eye. The home is an experience in refinement and grace, yet it has a very comfortable scale. A visit will evoke past times of old New England.