Chondroitin sulfate (CS) has anti-inflammatory properties and increases the regeneration ability of injured bone. In different in vivo investigations on bone defects the addition of CS to calcium phosphate bone cement has lead to an enhanced bone remodeling and increased new bone formation. The goal of this study was to evaluate the cellular effects of CS on human mesenchymal stem cells (hMSCs). In cell culture experiments hMSCs were incubated on calcium phosphate bone cements with and without CS and cultivated in a proliferation and an osteogenetic differentiation media. Alkaline phosphatase and the proliferation rate were determined on days 1, 7 and 14. Concerning the proliferation rates, no significant differences were detected. On days 1, 7 and 14 a significantly higher activity of alkaline phosphatase, an early marker of osteogenesis, was detected around CS modified cements in both types of media. The addition of CS leads to a significant increase of osteogenetic differentiation of hMSCs. To evaluate the influence of the osteoconductive potency of CS in twelve adult male Wistar rats, the interface reaction of cancellous bone to a nanocrystalline hydroxyapatite cement containing type I collagen (CDHA/Coll) without and with CS (CDHA/Coll/CS) was evaluated. Cylindrical implants were inserted press-fit into a defect of the tibial head. 28 days after the operation the direct bone contact and the percentage of newly formed bone were significantly higher on CDHA/Coll/CS-implants (p < 0.05). The addition of CS appears to enhance new bone formation on CDHA/Coll-composites in the early stages of bone healing. Possible mechanisms are discussed.