The Tejfalussy House, adjacent to the Franciscan Monastery, derives its name from its founder, György Tejfalussy (Milchdorfer), a singing canon. In its place, it is likely that two early Baroque buildings stood previously. Tejfalussy built the current two-story Baroque main building in 1772 on the site of these buildings, constructed on the double castle wall. The ground-floor annex standing next to the long, narrow courtyard can be considered as the original two early Baroque residential houses. An interesting aspect of this is that its layout evokes the characteristics of the castle before the palace constructions of the 18th century: the narrow dead-end streets, alleys, so-called "turn back" streets.
The building fits into the street line, with a stepped-back facade on its southern side, which shows a similar division to the nearby Biró-Giczey House. The residential building has an extended, irregular floor plan. Its street wing is single-story with a historicising character. The perpendicular, rectangular-shaped western wing is three stories high and carries Baroque style features. Inside the main Baroque building, there are vaulted rooms and an original staircase. The basement of the building may have previously served as a casemate.
On the upper floor, in the antechamber, during research, Baroque-era wall layers were discovered. The walls are covered with dynamically painted wall paintings imitating protruding stucco elements and tympanum decorations. Corinthian columns are visible on the side walls.
The building underwent several renovations, and in 1985, it became the museum and main exhibition venue of the Veszprém Bishopric. The collection, with its thousands of valuable artworks, is the second richest in Hungary among ecclesiastical treasures. Among the treasures stored here are a set of vestments made from the coronation robe of Queen Elizabeth in 1867, the pastoral staff of Cardinal Károly Hornig made in Vienna, and items belonging to József Mindszenty, a Bishop of Veszprém.
Renovation works are still ongoing in the building.