What evidence do we have that distant galaxies are moving away from us?

Using the redshift of electromagnetic spectra you can determine the current distance and speed of remote galaxies. Observing the same galaxies over time you can determine that the galaxies are moving away from us and accelerating. You will also note that their speed is proportional to their distance (the further away they are the faster they are moving), which is a feature of metric expansion.