but it’s more important whether people around me think I’m a good person or not.

No, it’s not. The people around Jimmy Savile thought he was a good person too.

It’s better to do actually do good and be seen as a bad person than the other way around.