It sounds like you're not distinguishing between shame & guilt. Where shame is the feeling that I am bad or wrong, guilt is feeling bad in response to having done something to another.