It's thought the short-sighted bird mistook the pet for a rat.
Luckily, the dog - a chihuahua - survived the ordeal.
It got away with cuts and bruises.
The bird - a Harris hawk called Galan - has been removed from his patrol at Bryant Park, near the city's famous Times Square.
Success
Up until the chihuahua attack, the pigeon-scaring scheme had been hailed a success.
It had cut the pesky pigeon population by 50%.
Many people don't like the birds because they scavenge for food and poo all over the place.
But now parks officers are calling for the scheme to be stopped.