Metallic glasses exhibit unique mechanical properties. For metallic glass composites (MGC), composed of dispersed nanocrystalline phases in an amorphous matrix, these properties can be enhanced or deteriorated depending on the volume fraction and size distribution of the crystalline phases. Understanding the evolution of crystalline phases during devitrification of bulk metallic glasses upon heating is key to realizing the production of these composites. Here, results are presented from a combination of in situ small- and wide-angle X-ray scattering (SAXS and WAXS) measurements during heating of Zr-based metallic glass samples at rates ranging from 10 ² to 10 ⁴ Ks ⁻¹ with a time resolution of 4ms. By combining a detailed analysis of scattering experiments with numerical simulations, for the first time, it is shown how the amount of oxygen impurities in the samples influences the early stages of devitrification and changes the dominant nucleation mechanism from homogeneous to heterogeneous. During melting, the oxygen rich phase becomes the dominant crystalline phase whereas the main phases dissolve. The approach used in this study is well suited for investigation of rapid phase evolution during devitrification, which is important for the development of MGC.