Who has the power to hold the federal bureaucracy accountable for its actions and policies?

It is the president, Congress and the courts who holds the federal bureaucracies accountable for their actions. Due to the fact that there are a number of separate agencies present in a bureaucracy, it would be difficult for the president to solely own the responsibility of these agencies. That is why, the Congress and the courts are given certain powers.