Matthew 11:18-19 KJV
For John came neither eating nor drinking, and they say, He hath a devil.  The Son of man came eating and drinking, and they say, Behold a man gluttonous, and a winebibber, a friend of publicans and sinners. But wisdom is justified of her children.
Human nature is and has always been the same since time immémorial in that no matter what you do, good or bad, people will talk about you, and not always in a good way. It’s a lose-lose situation to try to conform to public opinion. “No matter what you do, bad or good, people are always gonna have something to say about it. Just remember this: if people always have something to say about your life, that’s saying little about their own” (Unknown).