Which organism is probably responsible for keeping the food web and the pyramids in their respective shapes?

I believe the correct answer is the producers.

Without the producers, the food web and the pyramids would change greatly. Everything depends on the producers - they produce everything that any other organism depends on. So if something happens to the producer level, then the entire scheme will be compromised.