This castle reached the level of second rank in the time of Constable Iranzo, it played an important role by taking sides, like Andújar, for the royalist side when in 1465 the enemies of the king laid siege to Jaén, and it became famous when, six years later , the warden Diego Frías arrested and ordered to lock up in his tower a rival of the Constable, Don Fernando de Acuña, son of the Count of Buendía and none other than nephew of the Archbishop of Toledo.
In reality, the castle, of small dimensions, was formed by a cylindrical tower with a crenellated parapet finish, as drew by Martín de Ximena Jurado. A stone in the upper tower appears to have had an inscription, probably Arabic. No trace of this tower has remained in the town. However, the head of the church has an enclosure that could correspond to remains of the castle. This solid semicircular masonry wall could be reused from a round tower of great proportions, sister to those of the castles of Rus and El Mármol, in the lands of Baeza.
This tower was declared a Site of Cultural Interest in 1985.