How long have counties been a part of the government structure of the United States?

Counties are part of our system of local government. They respond to local community needs, while also supporting the state and federal governments. County responsibilities may include responding to emergencies, law enforcement, paving and repairing roads, creating and managing parks, and making sure we all have clean water to drink - just to name a few! Where did counties come from and how did they develop these responsibilities?