What safeguards did the founders put in place to guard against the excesses of majority rule?

They put the electoral college in place.

Because of the electoral college with the option of faithless electors, the states could not just win with a majority of votes at the expense of minorities. The electors were originally described as people who were supposed to judge the situation for themselves and vote individually, but the winner takes it all system ruined this idea.