This is what exactly happened when I started writing. By profession, I am an urosurgeon. So, yes I do need permission of the patients to operate upon them. But I never required permission of anyone to start writing, which I did.
Many of my colleagues made a mockery of that because I was exiting the conventional wisdom and they were feeling like ‘How can he do both the things?’. Eventually, almost 8 years have gone by and they have become fans of my write ups. I have 9 books under my belt in my vernacular language.
So, yes. Initially they will make fun of you, then they will oppose you. Then they will either join you or appreciate you. The aim should be not to stop.
If you stop and throw stones at every barking dog, you will reach nowhere.