Zinc (Zn) is vital to marine organisms. Its active uptake by phytoplankton results in a substantial depletion of dissolved Zn, and Zn bound to particulate organic matter replenishes dissolved Zn in the ocean through remineralization. However, we found that particulate Zn changes from Zn bound to phosphoryls in cells to recalcitrant inorganic pools that include biogenic silica, clays, and iron, manganese, and aluminum oxides in the Southern Ocean water column. The abundances of inorganic pools increase with depth and are the only phases preserved in sediments. Changes in the particulate-Zn speciation influence Zn bioavailability and explain the decoupling of Zn and phosphorus and the correlation of Zn and silicon in the water column. These findings reveal a new dimension to the ocean Zn cycle, implicating an underappreciated role of inorganic Zn particles and their impact on biological productivity.