The people who keep a check on how well schools are doing - Ofsted - want something done.
Although some schools have tried to improve games sessions, a quarter of them just aren't up to scratch yet.
But schools are really trying to give you more exciting sports to have a go at, like street hockey and orienteering.
The government wants three-quarters of 16-year-olds in England to do at least two hours of "high-quality" PE and sport a week by 2006.
And they want teachers to be better trained in taking PE.
Hear story
Would you stay at school for more PE?
Are your PE lessons any good?
