How does the house of representatives determine the rules of proceedings (the ability to have filibusters, riders, etc.) ?

The house regulates its rules of proceedings by voting on them, keep journal of all proceedings and each house sets its own rules and must agree upon the rules in a meeting. Based on the article I by the legislative branch of section 5 - membership, rules, journals and adjournment, respective house must be the judge of the elections, returns and credentials of its own members and a majority of each must establish a quorum to do business but a smaller number may suspend from day to day and may be approved to induce the attendance of absent member in such manner and under such penalties as each house may offer.