In the phrase, "no child stirs under my withering heart" what is the explicit meaning?

No one can make the narrator feel more mortified and humiliated than he already feels deep down in his heart. Children tend to not have a filter when they talk to people so something they say can mean something completely different to the narrator than what it means to the child.