He was leader of a group called The Supreme Council for the Islamic Revolution in Iraq.
That's a group which opposed Saddam Hussein for 20 years.
The bomb blew up near the Tomb of Ali in the central Iraqi city just as main weekly prayers were ending.
It's one of the holiest shrines for Shia Muslims and the leader was just leaving after prayers with many other people.
No group has admitted carrying out the attack.