Ribosomes that synthesize proteins are among the most central and evolutionarily conserved organelles. Given the key role of proteins in cellular functions, prokaryotic and eukaryotic pathogens have evolved potent toxins to inhibit ribosomal functions and weaken their host. Many of these ribotoxin-producing pathogens are associated with food. For example, food can be contaminated with bacterial pathogens that produce the ribotoxin Shiga toxin, but also with the fungal ribotoxin deoxynivalenol. Shiga toxin cleaves ribosomal RNA, while deoxynivalenol binds to and inhibits the peptidyl transferase center. Despite their distinct modes of action, both groups of ribotoxins hinder protein translation, but also trigger other comparable toxic effects, which depend or not on the activation of the ribotoxic stress response. Ribotoxic stress response-dependent effects include inflammation and apoptosis, whereas ribotoxic stress response-independent effects include endoplasmic reticulum stress, oxidative stress, and autophagy. For other effects, such as cell cycle arrest and cytoskeleton modulation, the involvement of the ribotoxic stress response is still controversial. Ribotoxins affect one organelle yet induce multiple toxic effects with multiple consequences for the cell. The ribosome can therefore be considered as the cellular "Achilles heel" targeted by food borne ribotoxins. Considering the high toxicity of ribotoxins, they pose a substantial health risk, as humans are highly susceptible to widespread exposure to these toxins through contaminated food sources.