Isn’t belief in karma psychologically damaging?

Question: Doesn’t the belief that our sufferings are due to our past karma add insult to injury? Isn’t it psychologically damaging to people who are already troubled by present problems to be told that they were sinful in the past?