Patient groups have met to discuss the future of maternity services in Mid Sussex hospitals.
Patients' groups say there is a lack of specialist staff
The Primary Care Trust wants to staff the Special Care Baby Unit (SCBU) at the Princess Royal Hospital in Haywards Heath with specialist nurses.
But patient representatives fear that advanced neonatal nurse practitioners will be in short supply and the unit will close due to lack of staff.
The formal consultation process runs until 22 February.
A spokesman for the patient and public involvement forum said: "If the SCBU has to close, very low risk births will take place in a midwife-led unit in Mid Sussex while the majority of women at higher risk will go to Brighton."
He said that in the face of national doctor shortages "there was no guarantee that nurse specialists could be retained or recruited in the longer term".
The forum also heard from neonatal specialists.