While working on the constitution, what aspect of the new government most concerned james madison?

Tyranny of the majority

An inherent weakness of majority rule in which the majority of an electorate can and does place its own interests above those of the minority. James Madison proposed a checks and balances system in the Constitution to protect against such tyranny