Old English had a word ‘mearc,’ meaning borderland or frontier. It survives as English ‘mark’ in words like Denmark (Dane+land), and the name Mercia, which comes from OE Mierce (borderland-dwellers).
Tolkien calls Rohan the ‘Riddermark’ - the land of the riders (OE ridda).