Specific diets for cancer patients have the potential to offer an adjuvant modality to conventional anticancer therapy. If the concept of starving cancer cells from nutrients to inhibit tumor growth is quite simple, the translation into the clinics is not straightforward. Several diets have been described including the Calorie-restricted diet based on a reduction in carbohydrate intake and the Ketogenic diet wherein the low carbohydrate content is compensated by a high fat intake. As for other diets that deviate from normal composition only by one or two amino acids, these diets most often revealed a reduction in tumor growth in mice, in particular when associated with chemo- or radiotherapy. By contrast, in cancer patients, the interest of these diets is almost exclusively supported by case reports precluding any conclusions on their real capacity to influence disease outcome. In parallel, the field of tumor lipid metabolism has emerged in the last decade offering a better understanding of how fatty acids are captured, synthesized or stored as lipid droplets in cancers. Fatty acids participate to cancer cell survival in the hypoxic and acidic tumor microenvironment and also support proliferation and invasiveness. Interestingly, while such addiction for fatty acids may account for cancer progression associated with high fat diet, it could also represent an Achilles heel for tumors. In particular n-3 polyunsaturated fatty acids represent a class of lipids that can exert potent cytotoxic effects in tumors and therefore represent an attractive diet supplementation to improve cancer patient outcomes.