The Castle of Chaumont was built on the remainders of an old feudal fortress. In XIth century that was kept by Guelduin of Saumur, faithful Counts of Blois against the Counts of Anjou. To XVth century Chaumont belongs to the family of Amboise. Pierre d' Amboise having adhered to the League Public property, the King of France Louis XI confiscates the field and makes dismantle the feudal Castle.
Pierre d' Amboise recovered thereafter his good and his son Charles I made build since 1469 the current castle.
The southern wings and east were high between 1501 and 1511. In 1560 Catherine de Medicis give up it to Diane De Poitiers in exchange of Chenonceau. It is into 1739 that the northern wing was destroyed to release the sight on the Loire.