You can't expect to get advice on "I have no ideal how to get out of this situation " if you don't give us examples of what they're accusing you of. If you don't deny lies and refuse to defend yourself, how do you expect to remedy the situation?
I have to agree, even though we've got to remember all the caveats I keep mentioning, (like anyone's private life should remain private, if any person wishes to largely keep it that way).
We can speculate though, whilst acknowledging we dont know what's going on, but just for sake of argument.
"Playing devils advocate", (and believe me I hate anyone playing devils advocate generally), lets assume the OP did do so much to "rock the boat" within the family, and the result was an almost inevitable breakdown of relationships (- all pure speculation obviously). Then there will be no easy answers for them will there(?).
On the other hand, I've got a very good mate whose alcoholism, and at times domineering personality has put great pressure on his relationships with his four children, (he's long since divorced from his ex.). One daughter will probably never have anything to do with him again, but the other three have been very sympathetic towards him, and put up with his extremely poor/controlling behaviour to an extent, seeing the good in him besides the bad, whilst at the same time protecting themselves too. In the circumstances I've described, those children are showing strength of character by taking a broader view aren't they, and should be applauded.
I've come to the conclusion my mate cant change, and his behaviour and attitudes are such that he doesn't want to, much to his own detriment and his families, (though they'll be okay, he just cant enjoy them as he otherwise would be able to do).