Avoid association of those with poor character – even if they are devotees
Friendship should be cemented between persons with mutual interests and
understanding. Such persons are said to be sva jati, “of the same caste.”
The devotee should avoid a person whose character is not fixed in the
standard understanding; even though he may be a Vaisnava, or a devotee of
Krsna, if his character is not correctly representative, then he should
be avoided.
Srimad Bhagavatam 3.29.17 purport