Self Esteem and Self Confidence are not the same thing
High self esteem and high self confidence will lead to a happy life. Doesn't necessarily mean a moral life, but you'll be happy with the result none the less.
The good news is that both attributes can be strengthened by different means. It shouldn't be surprising to find one is easier than the other.
Mark Goulston provides as very concise distinction between the two and offers the Top 10 measures of self esteem on the Never Eat Alone blog.