The Baroque castle Katzenstein was built in the 16th and 17th century and is located in the centre of Begunje. During World War 2, it held German prisons. In the ground floor some original prison cells are still preserved and have now been converted into a memorial museum. The most interesting parts of the castle are: the Plečnik pavilion, the chestnut promenade, and the built garden pavilion. Today the central part o the castle houses a psychiatric hospital. The small museum collection of the band Avsenik is on display in a nearby inn.