Chemo-resistance in acute myeloid leukemia (AML) patients is driven by leukemic stem cells (LSCs) resulting in high rates of relapse and low overall survival. Here, we demonstrate that upregulation of the splicing factor, RBM17 preferentially marks and sustains LSCs and directly correlates with shorten patient survival. RBM17 knockdown in primary AML cells leads to myeloid differentiation and impaired colony formation and in vivo engraftment. Integrative multi-omics analyses show that RBM17 repression leads to inclusion of poison exons and production of nonsense-mediated decay (NMD)-sensitive transcripts for pro-leukemic factors and the translation initiation factor, EIF4A2. We show that EIF4A2 is enriched in LSCs and its inhibition impairs primary AML progenitor activity. Proteomic analysis of EIF4A2-depleted AML cells shows recapitulation of the RBM17 knockdown biological effects, including pronounced suppression of proteins involved in ribosome biogenesis. Overall, these results provide a rationale to target RBM17 and/or its downstream NMD-sensitive splicing substrates for AML treatment.