The bone microenvironment is a complex tissue in which heterogeneous cell populations of hematopoietic and mesenchymal origin interact with environmental cues to maintain tissue integrity. Both cellular and matrix components are subject to physiologic challenges and can dynamically respond by modifying cell/matrix interactions. When either component is impaired, the physiologic balance is lost. Here, we review the current state of knowledge of how glycosaminoglycans - organic components of the bone extracellular matrix - influence the bone micromilieu. We point out how they interact with mediators of distinct signaling pathways such as the RANKL/OPG axis, BMP and WNT signaling, and affect the activity of bone remodeling cells within the endosteal niche summarizing their potential for therapeutic intervention.