President Andrew Jackson bought The Hermitage property in 1804. At first, he lived in his log cabin for 17 years before moving into the brick mansion.