István Koháry began renovating the outer walls and the castle building in 1960. The lord lieutenant János Forgách and his wife, Margit Cziráky bought back most of the estate from Koháry by 1739. In 1753 the youngest son of János Forgách, Zsigmong inherited the estate. The Szécsény Castle was rebuilt in the baroque style in 1750-1760, probably by Zsigmond.