For self-control, we need the protection of the Lord

Unless one is very strong in knowledge, patience and proper bodily, mental and intellectual behavior, controlling one’s lusty desires is extremely difficult. Thus after seeing a man embracing a young woman and practically doing everything required for sex life, even a fully qualified brahmana, as described above, could not control his lusty desires and restrain himself from pursuing them. Because of the force of materialistic life, to maintain self-control is extremely difficult unless one is specifically under the protection of the Supreme Personality of Godhead through devotional service.

Srimad Bhagavatam 6.1.62 purport