A group of elephant conservationists got together in the Sri Lankan capital, Colombo, on Friday to discuss the problem.
Because the elephants' natural home is being destroyed, they are forced to wander into farms and villages to look for food, and they end up damaging crops.
Asian elephants have a bath
Angry farmers then respond by killing or hurting them.
Sri Lanka has another problem for the elephants too.
A civil war there has disturbed about 300 wild elephants, making them wander into villages even more than before, which is making the problem worse.
Hear story
Play Poacher Patrol!
Test your elephant facts
