Also, it always bothered me when Jesse screamed at Walt for ruining his life and saying he now has nothing and no one left. Well, he lost his woman but he didn't have her when he met Walt, so that's a bunch of B.S. And what else had he lost at that point? Nothing that I can think of. (Walt hadn't gone on a murdering rampage yet).
Jesse had probably found the most stability of his entire adult life when he was working for Gus and Mike. He was sober, he was always on time and diligent about his "work," and he practically had a family with Andrea and Brock. After bringing down Gus, Walt manipulated Jesse into leaving that family, taking away the only happiness Jesse had left, and it's no coincidence that Jesse is no longer sober.
Also, since you asked what negative things have happened to Jesse as a result of Walt:
The death of one of Jesse's best friends and street dealer, "Combo,"
The death of Jane, Jesse's girlfriend (like you said, Jesse isn't aware of this)
He's nearly been beaten to death several times
His mentor, Mike Ehermantraut was killed by Walt
He was forced to kill Gale Boetticher
While the murder of Gale actually saved Walt's and Jesse's life, it is symbolic of the psychological damage that Walt has inflicted upon Jesse over the course of series. We see in Badger and Skinny Pete what Jesse would be without Walt in his life - a poor junkie who spends a lot of time debating the merits of Star Trek or Babylon 5, but who still has a clear shot at happiness or a normal life. Walt took all of that away (more than once), and Jesse knows it.