Gray hair in your early 20's: Is it something to worry about? � Possibly, say the doctors, though for very different reasons. Dr. Goldberg, a conventional physician, suggests that there may be some form of underlying disease, but also suggests taking your family into consideration. If for example, your father also went gray at an early age, there is probably nothing to worry about. Dr. DeOrio suggests that there may be a malabsorption issue in the body, and suggests taking pantothenic acid, in combination with other B-Complex vitamins.