Should I leave my boyfriend?

I've been with my bf since 2006, we have a 3 year old daughter together. This is the situation.
Before I met my bf, I had only just gotten out of 5 year abusive relationship. and then just jump straight back into another (new) relationship with my bf (current). I wasn't working when i met my current bf, i was studying business thou my home and looking for work at the same time. My bf was working full time. I was living with my grandmother, only had been for maybe approx 2 months or so, not long at all.
well not long after even knowing him, only just met this man, he asked me to move in with him, during around the time he asked, I was having problems at home with my grandmother as she was telling lies to my auntie (her daughter) about me not cleaning the house up to her expectations, and she use to test me, like their was this dead spider she left in the other bathroom, and i had saw it, but didn't really think much of it at the time and just left it. Little did i know it was a test to see if i would get rid of it, and clean it. (it was in the bath) That was the type of things she would do. and I always cleaned up after my self, like did dishes and keep my room clean. But I had no idea she excepted me to clean all inside the kitchen cupboards and dust everything all the time. well my auntie came around one time and was questioning me about do I things to help out her mother (my grandmother) do I do this, and do it do that? and just got really nasty towards me in that way. So when this man (my new friend at the time, who liked me more then friends, my now bf) asked me to move in with him, It was idea choice for me at the time. and I decided to give it a go.
So i have been with him for now 5 years, I meet him in 2006 and moved in in 2006. Then in july 2007 i fell pregnant.

But before I fell pregnant, he use to take me out on the weekends for a few drinks. and we use to got out to the markets and stuff, and he use to take me to movie world, he just use to take me out.
When i got pregnant, i couldn't do too much. and then when i had my daughter after she was born, well i really couldn't do too much.

I can't really remember exactly how my current bf started thinking he can or thinks he can just push me around because my ex use to. Well one time he said that thinks he can hit me because my ex use to, that really does my head in him he saying that.

There are too many different moments to actually point into this description. But to make it short i was with my ex bf who was much more of a stronger personality and more violent. My ex was a badboy.
My current bf comes across really as a badboy wanna be, in other words he's nothing like my ex. but at the same time, he is only in the way he's trying to be because he treats me badly.

ok, i'll try and cut this short, it's just hard to and explain everything to give a clear picture at the same time.

More towards recent times. My bf says he hates me and has for 2 years or so now, and only pretends to love me for our daughter sake and to keep the peace around the house and so i stay here with out daughter.

I try and ask him why he hates me and how did it start 2 years ago (the hate towards me) and he always says he doesn't want to talk. and never really has a reason why. it seems that he hates supporting me financially, which i haven't been working and staying home looking after our daughter.

Which he's been useless with, i mean he doesn't change her nappies, feed her or dress her or bath her, it's all me, i do EVERYTHING!. .. . I mean i do it all.

I know my daughters moods and her needs way better then him, and he's just never been good with her.
The last time he changed her nappy may or been once or twice when she was a new born. and i can hardly even remember it.

If I left him, the only place I have to go too is my moms house. (my mom lives with her husband and there 4 kids) and the thing is she said that they will move into a bigger house if id decided to go live with them. Which means they would be paying higher rent, and they could because i would be helping them with board.

The thing is i don't want to leave if my bf is going to change his mind about wanting me to leave in about a month or 2 down the track.

Because i can't do that to my mom after she and her husband gone and moved out into a bigger house for me so I can go live with them. I mean they will end up being stuck with higher rent if i did that. and it wouldn't be fair on them. after they tried to help me out.

One of the main reason's why i stay and put up with his sh*t is because i only have 1 place to go, and as nice as it is for my mom and her husband to have me live with them, my mom is not always easy to live with, i mean she can be a real b*tch putting aside the fact that she's letting me live with her.
and I have depression and even when i try and stay there just for a few nights, it's very hard too, so i end up coming home early.

well anyway, try and make a good judgment please with what i've said and my cons and pros
some of my cons and pros may explain a little more of the situation.