What would the speaker in "Mending Wall" do if he could

In the poem, the mending wall, the speaker says that only if he could he will tear down the wall and get close to his neighbour. This is because he is not able to see the logic or the reason behind the existence of the wall. However, there is disagreement from the side of the neighbour and she is still in the favour of mending the wall. She further claims that good fences make good neighbours which shows that she completely denies the speaker's idea of breaking down the wall.

Tear down the wall and get closer to his neighbor.