Helme church parish was first mentioned in 1329 during a Lithuanian raid. Most of the neighboring land was fiefed in the 15th–16th centuries. Livonian Order castle in Helme (Ordensburg Helmet) was probably built in the first half of the 14th century. The site on a steep hill is believed to have been used as a stronghold earlier by Sackalians in the Ancient Estonia. By its ground plan the order castle was 120×60 m oval shaped structure, surrounded by two moats. There was a borough beside the castle in the Middle Ages; it was mentioned until the 17th century. The castle was destroyed by the Swedes during the Russo-Swedish War in 1658. Nowadays only parts of the walls with high window holes have survived
