It is estimated that there are 100 million illicit small arms in Africa, crippling development in many areas of the continent.
Some countries like Kenya and Tanzania have blamed the increase in violent crimes on the small arms that are smuggled into their countries.
However, a United Nations report earlier this year accused Somalia's neighbours of breaking an arms embargo on the war-torn country.
The BBC's Cathy Jenkins in Nairobi says measure being considered at a conference on the trade in small arms in the Kenyan capital, Nairobi, are:
A summary of the consequences described how the sub-region has been ravaged by the easy availability of light weapons which are used in inter-ethnic conflicts, by urban criminals, and by cattle-rustlers.
Daunting task
Some areas are no-go areas for development workers, thus depriving whole communities of much-needed help.
And the majority of victims are women, the elderly and children.
Kenya's Foreign Minister Marsden Madoka told delegates that the task was a daunting one and that their respective governments had to demonstrate unwavering political determination to follow through initiatives.
He said it was crucial that the conference came up with concrete proposals to eradicate the problem.
Observers from civil society agreed with the urgency of his message.
Haruun Ruun of the New Sudan Council of Churches said that unnecessary suffering had to come to an end, so that people and communities could develop.
Two years ago, the countries of the Great Lakes region and the Horn of Africa launched an initiative to combat the problem of small arms trafficking.
This week's conference has been called to review the steps taken so far.
The UN report accused Ethiopia, Eritrea and Djibouti of selling weapons to various Somali factions despite an international ban on selling weapons to Somalia.