The cushioning function of large arteries encompasses distension during systole and recoil during diastole which transforms pulsatile flow into a steady flow in the microcirculation. Arterial stiffness, the inverse of distensibility, has been implicated in various etiologies of chronic common and monogenic cardiovascular diseases and is a major cause of morbidity and mortality globally. The first components that contribute to arterial stiffening are extracellular matrix (ECM) proteins that support the mechanical load, while the second important components are vascular smooth muscle cells (VSMCs), which not only regulate actomyosin interactions for contraction but mediate also mechanotransduction in cell-ECM homeostasis. Eventually, VSMC plasticity and signaling in both conductance and resistance arteries are highly relevant to the physiology of normal and early vascular aging. This review summarizes current concepts of central pressure and tensile pulsatile circumferential stress as key mechanical determinants of arterial wall remodeling, cell-ECM interactions depending mainly on the architecture of cytoskeletal proteins and focal adhesion, the large/small arteries cross-talk that gives rise to target organ damage, and inflammatory pathways leading to calcification or atherosclerosis. We further speculate on the contribution of cellular stiffness along the arterial tree to vascular wall stiffness. In addition, this review provides the latest advances in the identification of gene variants affecting arterial stiffening. Now that important hemodynamic and molecular mechanisms of arterial stiffness have been elucidated, and the complex interplay between ECM, cells, and sensors identified, further research should study their potential to halt or to reverse the development of arterial stiffness.