Residents in the Gorse Hill area of Swindon are calling for action to stamp out prostitution in the area.
They claim that efforts to remove the women from the town's Manchester Road red light district has simply displaced the problem to their neighbourhood.
Some families have told the BBC they are scared to go out at night and one father said he was worried about the area his baby son was growing up in.
Councillor Maurice Fanning promised action but said it would not be easy.
"Roman Centurions tried to solve this problem, they didn't succeed," he said.
"With the best will in the world, it's the oldest profession and it will re-emerge. Whilst there is custom for what they are providing, it will continue."