Tumorigenesis ensues within a heterogeneous tissue microenvironment that promotes malignant transformation, metastasis and treatment resistance. A major feature of the tumor microenvironment is the heterogeneous population of cancer-associated fibroblasts and myeloid cells that stiffen the extracellular matrix. The heterogeneously stiffened extracellular matrix in turn activates cellular mechanotransduction and creates a hypoxic and metabolically hostile microenvironment. The stiffened extracellular matrix and elevated mechanosignaling also drive tumor aggression by fostering tumor cell growth, survival, and invasion, compromising antitumor immunity, expanding cancer stem cell frequency, and increasing mutational burden, which promote intratumor heterogeneity. Delineating the molecular mechanisms whereby tissue mechanics regulate these phenotypes should help to clarify the basis for tumor heterogeneity and cancer aggression and identify novel therapeutic targets that could improve patient outcome. Here, we discuss the role of the extracellular matrix in driving cancer aggression through its impact on tumor heterogeneity.