The BBC's Berlin correspondent says there is considerable hostility in Germany to anything which implies that the country is big and powerful and inclined to exert its influence in Europe.
Built at a cost of more than $20m, the new Chancellery lies in the heart of the rebuilt government quarter next to the parliament building, the Reichstag.
Mr Schroeder - like many Germans - has expressed doubts about the sheer scale of the structure, which has been dubbed The Washing Machine, with almost 400 offices located within two imposing wings.
The BBC's Berlin correspondent says there is considerable hostility in Germany to anything which implies that the country is big and powerful and inclined to exert its influence in Europe.
Mr Schroeder officially receives the key to the new building on Wednesday, when the first Cabinet meeting takes place there.
As one of his first visitors, Mr Schroeder met with the Chancellery architect Axel Schultes.
Countering criticism
Mr Schultes has countered the criticism of those who say the white concrete building is too large.
Mr Schroeder himself has joked that the massive dimensions of the new residence seemed better suited to his bulky predecessor, Helmut Kohl, who commissioned it.
Along with Mr Schroeder, 510 Chancellery workers have moved in to their 370 offices in the 19,000 square-metre (205,000 square foot) building.
The new building is part of the rebuilt government quarter in Berlin, where the capital returned in summer 1999, around the landmark Reichstag parliament building.
Mr Schroeder had previously been working out of the building in eastern Berlin used by the leaders of East Germany.