Given that quartz has such an amazing variety of colors, why are they all considered to be the same mineral species?

They are all considered to be the same mineral because they are made up of essentially the same chemicals. Minerals are usually classified based on the type of compounds that are found in them. They may be of different color but it they are made up of the same chemical compounds they will be grouped together.