Why was farming not very profitable in the New England colonies?

In colonial times, the New England colonies had cold climates, a short growing season, and brittle soil, which could grow little crops. Therefore, the colonists has to result to a different method to sustain their economy and turned to fishing, lumber, shipbuilding, and other industrial occupations.