The ego is difficult to eradicate completely. Because of its presence, we are bothered by others for various reasons, we disapprove of them and start judging unknowingly. The solution is to seek refuge in the Lord, letting him be the only one to affect you. This way, you only care about what he thinks of you. It's you and God alone, living in peace. If you can live in peace with God, then nothing in the world shall be able to take that peace away from you.