Freedom to move ahead or fall behind the tempo of a piece is called

The answer is rubato

rubato is initiated by disregarding the strict tempo, and give a freedom for the player to conduct a personal expressive style (without altering all over the place)

It is very common to see Rubato in Jazz genre (usually being done by the most skilled player in the group)