But the refugee organisation is laying on buses to only three towns which have been declared safe by Nato.
(Click here to see a map showing refugee movements)
The agency is planning to provide the refugees with monthly rations until life can return to normal.
Representatives from the Mother Theresa Society are also on hand in the provincial capital to provide support to the new arrivals.
KLA disarm
In another development, hundreds of Kosovo Liberation Army (KLA) fighters have been handing in their weapons and moving into special assembly points across Kosovo.
Under an agreement signed last week the KLA has until midnight on Monday to take its soldiers and weapons off the streets.
The Supreme Commander of Nato forces, General Wesley Clark, told the BBC that KLA commanders were co-operating well on demilitarisation.
But he said he was concerned about how individual members would behave, given the anger among Kosovo Albanians.
The agreement gives the KLA 90 days to disarm completely. Most of their weaponry is to be kept in storage places supervised by the international peacekeeping force.
Impartial system
The first tentative steps towards creating a new civil administration have also been taken.
The UN's special representative in Kosovo, Sergio de Mello, swore in seven legal experts who will help select judges and create a new, impartial, multi-ethnic judicial system.
The experts consist of members of the international community, Kosovo Albanians and a Serb.
At the same time an advance contingent of UN international police has arrived from Bosnia.
Some 3,000 UN civilian police will be based in Kosovo, and eventually they hope to create and train a local police force.
Other top stories