Magnesium, an essential mineral for human health, plays a pivotal role in the cardiovascular system. Epidemiological studies in the general population have found an association between lower dietary magnesium intake and an elevated risk of cardiovascular events. In addition, magnesium supplementation was shown to improve blood pressure control, insulin sensitivity, and endothelial function. The relationship between magnesium and cardiovascular prognosis among patients with chronic kidney disease (CKD) has been increasingly investigated as it is becoming evident that magnesium can inhibit vascular calcification, a prominent risk of cardiovascular events, which commonly occurs in CKD patients. Cohort studies in patients receiving dialysis have shown a lower serum magnesium level as a significant risk for cardiovascular mortality. Interestingly, the cardiovascular mortality risk associated with hyperphosphatemia is alleviated among those with high serum magnesium levels, consistent with in vitro evidence that magnesium inhibits high-phosphate induced calcification of vascular smooth muscle cells. Furthermore, a harmful effect of high phosphate on the progression of CKD is also attenuated among those with high serum magnesium levels. The potential usefulness of magnesium as a remedy for phosphate toxicity should be further explored by future intervention studies.