Do you think families can be tarred with same brush?

I shall explain better. If say a relative of yours is a complete jerk and you have disowned them publicly and have nothing to do with them for over 15yrs or so,do you think that other people in your area just lump you in with them and therefore arent that nice to you as a result of what that relative may have done to them? I think that in my area they do and have received a few comments that Im one of them so I must be a tightwad or a mean person.. Do you think like this of people in your area and why? I find it most annoying and upsetting that people think my family are in anyway like this relative especially as I have stated that I do not talk to them or have anything to do with them..