B/F help would you do this?

I have a b/f that I rekindled a relationship with from back in high school. the problem is his sister and father dont really like me, and I told my mother about me seeing him yesterday and she called him a a%%h*le. My daughter is mad because she met him and he pestered her so she would leave the room and leave us alone. What would you do?