With the goal to study dissipative Landau-Zener (LZ) sweeps in realistic solid-state qubits, we utilize novel methods from non-Markovian open quantum system dynamics that enable reliable long-time simulations for sub-Ohmic environments. In particular, we combine a novel representation of the dynamical propagator, the uniform time evolving matrix product operator method, with a stochastic realization of finite temperature fluctuations. The latter greatly reduces the computational cost for the matrix product operator approach, enabling convergence in the experimentally relevant deeply sub-Ohmic regime. Our method allows the exact simulation of dynamical protocols with long operation times, such as the LZ sweep, in challenging parameter regimes that are realized in current experimental platforms.