Bad association makes material existence intolerably miserable
Being in the material world is certainly miserable, but certainly when one is put into the association of asuras, or atheistic men, it is intolerably so.
Srimad Bhagavatam 7.9.16 Purport