Nonlocal elastic constitutive laws are introduced for crystals containing defects such as dislocations and disclinations. In addition to pointwise elastic moduli tensors adequately reflecting the elastic response of defect-free regions by relating stresses to strains and couple-stresses to curvatures, elastic cross-moduli tensors relating strains to couple-stresses and curvatures to stresses within convolution integrals are derived from a nonlocal analysis of strains and curvatures in the defects cores. Sufficient conditions are derived for positive-definiteness of the resulting free energy, and stability of elastic solutions is ensured. The elastic stress/couple stress fields associated with prescribed dislocation/disclination density distributions and solving the momentum and moment of momentum balance equations in periodic media are determined by using a Fast Fourier Transform spectral method. The con-voluted cross-moduli bring the following results: (i) Nonlocal stresses and couple stresses oppose their local counterparts in the defects core regions, playing the role of restoring forces and possibly ensuring spatio-temporal stability of the simulated defects, (ii) The couple stress fields are strongly affected by nonlocality. Such effects favor the stability of the simulated grain boundaries and allow investigating their elastic interactions with extrinsic defects, (iii) Driving forces inducing grain growth or refinement derive from the self-stress and couple stress fields of grain boundaries in nanocrystalline configurations.