Rant but what should I do

So my family except for 2 family members support my decision on my life. My family says that oh he’s just using you and so on. Sure he spoils me which is ok. My family says that I need to stop paying for everything when I don’t in the first place. I pay the rent and he pays for the food and other things. I have a disability check and if I make more then I get I loose it so he said I could pay for the rent or the food up to me he doesn’t care. I choose rent so I am paying 830 the other hundred something is mine to do what I feel with. My family doesn’t listen to me about it except for my granny and sister. He takes me to see them I pay for gas even if I have to give it to him 5 times before he takes because he says I don’t want your money baby. They say he’s controlling and stuff when he’s not so what should I do. Thanks for your help