It was built on the remains of the old Castle of Bailén, built by Abderramán I in the s. IX, on a Visigoth monastery. From 1349 it belonged to the Ponce de León family, the first Counts of Bailén, until it was acquired by the mining family of the Bonaplata, who in 1893 sold it to the City Council, which installed its premises until 1930.