The International Classification of Functioning, Disability and Health (ICF) published in 2001 describes the consequences of health conditions with three components of impairments in body structures or functions, activity limitations and participation restrictions. Two of the new features of the conceptual model were the possibility of feedback effects between each ICF component and the introduction of contextual factors conceptualized as moderators of the relationship between the components. The aim of this longitudinal study is to provide empirical evidence of these two kinds of effect. Structural equation modeling was used to analyze data from a French population-based cohort of 548 patients with knee osteoarthritis recruited between April 2007 and March 2009 and followed for three years. Indicators of the body structure and function, activity and participation components of the ICF were derived from self-administered standardized instruments. The measurement model revealed four separate factors for body structures impairments, body functions impairments, activity limitations and participation restrictions. The classic sequence from body impairments to participation restrictions through activity limitations was found at each assessment time. Longitudinal study of the ICF component relationships showed a feedback pathway indicating that the level of participation restrictions at baseline was predictive of activity limitations three years later. Finally, the moderating role of personal (age, sex, mental health, etc.) and environmental factors (family relationships, mobility device use, etc.) was investigated. Three contextual factors (sex, family relationships and walking stick use) were found to be moderators for the relationship between the body impairments and the activity limitations components. Mental health was found to be a mediating factor of the effect of activity limitations on participation restrictions.