You're a contributor in multiple ways.
Can't make everybody happy. Don't try. Teddy Roosevelt said (very approximately) that there's the man on field of battle, bruised, bloody and gettin' it done, then there's the critics on the sidelines, telling him how to improve. While differences of opinion do exist, my personal opinion is that much of the heat you've taken -without, afaik saying much about it - originates in the Peanut Gallery.
Starting a new business usually is all-encompassing. Stay on it, drop in when you get a chance and know for a FACT that you're missed.