A town in north Kent could be turned into a ghost town if plans to move the market are agreed, the Labour Medway Group has said.
Gillingham's market could be moved to the railway car park, under proposals from some shopkeepers put before the Conservative-run Medway council.
A Conservative councillor said there were no plans to move the market, but the proposals would be looked at.
The Medway Labour Group said it would be "the kiss of death for Gillingham".
Councillor Jane Chitty, portfolio holder for strategic development and economic growth, said some shopkeepers thought the market takes business away from them.
"Some retailers also said the market brings customers in," she said.
Labour Councillor Adam Price said some retailers were amazed when they heard about the proposals.
Ms Chitty said she did not want to prevent any form of discussion on the idea and the proposals would go to public consultation.