Diabetes mellitus is a growing health challenge globally which is increasing in epidemic proportion. Naturally occurring pharmacological agents are more likely to provide beneficial therapeutic effects without undesirable side effects compared to the synthetic agents. There is a growing evidence that some naturally occurring pharmacological agents derived from plants have potential antihyperglycemic effects. In this study, we have reviewed the molecular mechanism behind potential hypoglycemic properties of four well-known herbal-based agents, namely, ginger, curcumin, garlic, and cinnamon. Also, we present the related clinical data confirming experimental results aiming to develop novel therapeutic strategies based on these herbal agents potentially for the management of patients with diabetes.