Eukaryotic cells have evolved extensive protein quality-control mechanisms to remove faulty translation products. Here, we show that yeast cells continually produce faulty mitochondrial polypeptides that stall on the ribosome during translation but are imported into the mitochondria. The cytosolic protein Vms1, together with the E3 ligase Ltn1, protects against the mitochondrial toxicity of these proteins and maintains cell viability under respiratory conditions. In the absence of these factors, stalled polypeptides aggregate after import and sequester critical mitochondrial chaperone and translation machinery. Aggregation depends on C-terminal alanyl/threonyl sequences (CAT-tails) that are attached to stalled polypeptides on 60S ribosomes by Rqc2. Vms1 binds to 60S ribosomes at the mitochondrial surface and antagonizes Rqc2, thereby facilitating import, impeding aggregation, and directing aberrant polypeptides to intra-mitochondrial quality control. Vms1 is a key component of a rescue pathway for ribosome-stalled mitochondrial polypeptides that are inaccessible to ubiquitylation due to coupling of translation and translocation.