They didn't have the right to live in the castle and make demands while being fed, sheltered, and guarded during the day. They totally had the right to abandon the castle to be sacked and then defend their cliffs from any other humans who came. That's basically what Demona wanted, and it was fair, if short-sighted (way more casualties in a perpetual war with all humans than in compromise with some of them) but what wasn't fair was that instead of getting the clan to agree, she made the decision for them.