Negative feelings towards the homeless, the mentally challenged, the mentally unbalanced, etc, all stem from a lack of social empathy.
Add to that the common fallacy that the homeless are homeless due to laziness.
Whenever someone says, "If I were homeless, I'd work my butt off until I could...