Why doesn’t my family care about me?
Your family is not responsible for coddling you every time the child's father comes over. You need to get counseling if you get anxious and upset every time you see him. You need to not react every time your ex pushes your buttons. If you are unable to do this, you should consider doing the custody exchange at a neutral site.
Your family is doing the best for your child. You need to stop reacting to your ex, especially in front of your child. Your ex does it to irritate you and get a reaction. If you stop giving him what he wants, he'll stop.
What can you do? Quit getting into arguments. You are broken up. Move on. When he comes to pick up the child, either go someplace else and let your parents handle it, or meet at a neutral place (like a fast food joint) and make a quick easy exchange without discussion. If you feel your family needs to "take sides" (which is very immature) then discuss it with them. You could also move out and be an adult.
Well your brother mom don't have to be on your side because your over 21. Your a full grown adult now. There obligation has ended.
stop being there when he picks her up