Officers in England and Wales have fired the 50,000-volt stun guns more than 1,000 times since 2004.
According to BBC home affairs correspondent Danny Shaw , there are 2,000 Tasers currently available for police in England and Wales.
About 6,500 firearms officers can use them, plus police response officers in the ten pilot forces.
The announcement to extend their use follows a year-long pilot scheme which saw Tasers issued to frontline officers in 10 police forces.
The Independent Police Complaints Commission said the pilot had not led to a big rise in complaints by the public.
But it has called better guidance and training for police when Tasers were used in 'drive-stun' mode (directly against the body), because this generated the most complaints.
The Home Office says that before the new Tasers are issued, all officers who use them will need to attend an 18-hour training course, spread over two to three days.
They will also be required to attend an annual "refresher" course to keep them up to date with developments.
Alan Campbell, Home Office minister responsible for crime reduction, told BBC Radio 4's Today programme the government had taken independent medical advice and that Tasers were "low risk".
He said: "They're used under very strict circumstances and there are very clear guidelines.
"Last year they were only used on 93 occasions out of the more than 600 that they were deployed. We don't expect them to be used as a weapon of choice routinely.
"I am sure one of the intentions is to make sure we don't need to use guns as often."
The Home Office is funding the Tasers, but the cost of training officers to use them will be paid by individual police forces.
The decision to extend their use has been welcomed by Acpo and by the Police Federation of England and Wales, which represents rank-and-file officers.
Police use a Taser stun gun to apprehend a man
Acpo's spokesman, and the assistant chief constable of Northamptonshire Police, Derek Talbot, said trials showed in the majority of cases Tasers helped police resolve incidents without resorting to a weapon.
Paul McKeever, chairman of the Police Federation of England and Wales, which represents rank-and-file officers, said the move recognised the "vital role" the weapons played in the fight against crime.
He said Tasers were an "effective and "less lethal alternative" to firearms.
But Oliver Sprague, of Amnesty International UK, told the BBC's Today programme the organisation's research indicated more than 320 people had died in the US since 2001 after they were "Tasered".
Ministers say they "do not recognise" Amnesty's fatality figures.
Mr Sprague said Amnesty was especially concerned about the welfare of vulnerable people who had "emotional" problems or were under the influence of drugs.
He said: "Amnesty is not opposed to the use of Tasers but they should be limited."
Describing the plans to extend the use of Tasers as "extreme", he said: "No matter how intensive the training is, the officers will only have had two days' worth."
He called on the home secretary to review her decision and restrict the use of Tasers to a small number of fully-trained officers.
This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.