Kos Manor was built in 1521 by Žiga Dietrichstein, tenant of the Habsburgs.  The Bela peč coat-of-arms is preserved above the balcony door and historical sources refer to it as “old Belapeč castle”. In the 18th century it was owned by the Khevenhüllers from Carinthia, Princes of Eggenberg and Counts of Trillegkh. In 1812 it was bought by merchant Frančišek Pavel Kos who renovated it in 1821. The manor has been named after him. At the end of the 19th century the Carniolan Industrial Company sold the building to Jesenice community. It housed a public school until 1915, during both world wars there were offices, a court of justice and prisons. The manor was renovated in 1985, and in 2024, the protocol rooms and the wedding hall on the second floor were renovated, and in 2024 a new permanent exhibition was also set up.

Today, the Kos Manor houses the offices of the custodians, the director's office and the accounting department. On the ground floor there is a gallery for temporary exhibitions (photographic, art, historical, ethnological exhibitions), and from 2024, the Kos Manor City Museum hosts a new permanent exhibition, Early Years of the Town of Red Dust, which presents the history of the town of Jesenice from 1929, when it became a town, to the mid-1950s. On the second floor are the municipal protocol and wedding halls.