This work was dedicated to the simulation of fiber composite structures consisting of carbon fibers and mineral impregnation. The aim of this study was to generate a micromodel that predicts the properties of a mineral-impregnated carbon fiber reinforcement. The numerical characterization was based on the discrete microscopic modeling of the individual phases using a representative volume element. In addition, the stochastic nature of the fiber strength, the anisotropic damage mechanisms of the brittle matrix, and the non-linear bonding behavior between the filaments and the matrix were considered in the material models. The material models were adjusted based on the literature sources and our own experimental investigations. This was followed by the validation of the representative volume element, quantifying the evolution of stiffness and damage under longitudinal tensile loading. The numerical results of material stiffness, as well as the tensile strength of the representative volume element, were compared with the results of the experimental investigations. To verify the robustness of the numerical model, significant model parameters were subjected to a sensitivity analysis.