Few things have impacted as much as poverty has. Homelessness, thievery, hits to my self-esteem--drive, ambition, work-ethic, all of these stem from poverty.
So many (poor/formerly poor) people have an ugly relationship to and with money. Once you've been poor, that poverty consciousness is really hard to shake. I've linked to some useful information to help navigate this.