The chateau stands on the rock spit in the small town Žirovnice above Hutní Rybník pond on the Žirovnice river.

Originally it was a Gothic castle founded here in the second half of the 13th century. It had a triangular layout with a round tower and the chapel on its southern side. In the end second half of the 14th century it was enlarged and fortified. During the 16th and 17th centuries it was continuously being reconstructed and it was finally rebuilt into the chateau. In 1910 the town bought it and the town museum was located here. In the 1960's the chateau burnt down, but it was quickly and completely restored.
A lot of owners changed there. The Šternberk family - one of the most important proprietors - owned it from 1693 till 1910.

The exhibitions of nacre-works can be visited in the chateau and the frescos in the original chapel from the end of the 15th century and the paintings in the chateau from the 16th century have been preserved up till the present day.