The museum wants to introduce people to different cultures, so will be offering the insects to all visitors at a tasting session on Thursday.
Museum manager Mike Graham said: "These insects have been bred for eating and are wholesome and nutritious.
"People think nothing about eating prawns and shrimps so why not insects?
"In some cultures many people get much of their nourishment from these tiny creatures."