Some schools are scared that if there is an accident they may be taken to court, so are choosing not to let pupils take part in outdoor activities.
Children learn lots about themselves and how to get on with others on the trips, but many don't get the chance.
But school inspectors reckon that as long as everything is organised well there is nothing to worry about.
They looked at lots of primary and secondary schools and 15 outdoor education centres.
They found the standard of teaching was good or better in many of the centres.
Children at the centres were also often well behaved and learnt lots about teamwork and leadership.
But teachers' union NASUWT disagrees with the inspectors, saying that even if rules were properly schools were still being sued.
Hear story
Should you be allowed to go on school trips?
I don't think kids exercise enough
