Lineage plasticity causes therapeutic resistance; however, it remains unclear how the fate conversion and phenotype switching of cancer-associated fibroblasts (CAFs) are implicated in disease relapse. Here, we show that androgen deprivation therapy (ADT)-induced SPP1+ myofibroblastic CAFs (myCAFs) are critical stromal constituents that drive the development of castration-resistant prostate cancer (CRPC). Our results reveal that SPP1+ myCAFs arise from the inflammatory CAFs in hormone-sensitive PCa; therefore, they represent two functional states of an otherwise ontogenically identical cell type. Antiandrogen treatment unleashes TGF-β signaling, resulting in SOX4-SWI/SNF-dependent CAF phenotype switching. SPP1+ myCAFs in turn render PCa refractory to ADT via an SPP1-ERK paracrine mechanism. Importantly, these sub-myCAFs are associated with inferior therapeutic outcomes, providing the rationale for inhibiting polarization or paracrine mechanisms to circumvent castration resistance. Collectively, our results highlight that therapy-induced phenotypic switching of CAFs is coupled with disease progression and that targeting this stromal component may restrain CRPC.Keywords: androgen deprivation treatment; cancer associated fibroblast; castration resistant prostate cancer; fibroblast plasticity.