What would be the right decision?

Sounds like me and my daughter's father, except he refuses to pay child support even with a court order. His family wants to see my lil girl as well. I said no because: they treated me really bad the whole time I was married to him, they are not good examples, and I don't want his flavor of the month to confuse my baby. She's only just turned 4 in april. I have to live with her not knowing her grandparents but: my parents divorced long ago so she still has 2 sets that love her.