Conservative leader David Cameron has urged people "not to walk on the other side" and take more responsibility for tackling anti-social behaviour.
The UK is suffering from "incredible incivility" and people "are rude to each other", he told BBC One's the Politics Show.
Mr Cameron said Labour wrongly thought the state was "always the answer".
He also reiterated his call for the government to "strengthen families" by changing the tax system.
Mr Cameron said: "My worry is that after a decade of a Labour government, that said the state is always the answer, more government is always the answer, they actually created the irresponsible society.
"They've taken responsibility away from people."
He added: "To me, Blair and Brown have...sucked responsibility away from people and I want to give it back to them."
Mr Cameron said anti-social behaviour orders were "being handed out like confetti" and that they were "being breached all over the place".
He added: "They're not working. And they're taking the responsibility away from parents."
Mr Cameron said bad behaviour was undermining "general well-being" and that people were afraid of tackling it because "they don't feel they can say anything, because they're going to get sworn at and shouted at".
He went on: "Don't walk on the other side. Government can't make all the difference on its own.
"What we need is what I talk about: social responsibility where we all take our responsibility - government, yes, but also individuals and families, businesses, and the media as well."
But asked if members of the public should confront gangs of youths dropping litter, Mr Cameron said people should not "do anything they don't feel comfortable with".
Mr Cameron's interview can be seen on the Politics Show on BBC One at 1400 BST on Sunday.