Maybe: Shame is not only based on judged moral failings, but almost any kind of failing which is judged harshly by self or other. For example, the race you mentioned, or the beauty, possessions, status, and popularity contest known as "social life".