Palm oil has been widely criticised for its high environmental impacts, leading to calls to replace it with alternative vegetable oils in food and cosmetic products. However, substituting palm oil would be environmentally beneficial only if the environmental footprint per litre oil were lower than those of alternative vegetable oils. Whether this is the case is not obvious, given the high oil yields of oil palm of up to 10 times those of alternative crops. Here, we combine global agricultural and environmental datasets to show that, among the world’s seven major vegetable oil crops (oil palm, soybean, rapeseed, sunflower, groundnut, coconut, olive), oil palm has the lowest average species richness and carbon footprint associated with an annual production of one litre of vegetable oil. For each crop, these yield-adjusted footprints differ substantially between major producer countries, which we find to be largely the result of differences in crop management. Closing agricultural yield gaps of oil crops through improved management practices would significantly reduce the environmental footprints per oil yield. This would minimise the need for further land conversion to oil cropland and indeed could increase production to such an extent that a significant area of oil croplands could be ecologically restored.