The building was constructed by Canon Imre Körmendy on a plot reinforced with retaining walls from the valley side between 1701 and 1725. Its northern and western facades have retained their original early 18th-century appearance. In 1950-51, it became the location of the Minor Seminary, then operated as a student hostel of the university from 1951 to 1958, and from 1976 onwards, it housed various secular higher education institutions. Interestingly, remains of a bastion dating back to around 1500 were unearthed in the corner facing the valley.
Renovation works are still ongoing in the building.
