Commercial haptic gloves and research prototypes often degrade hand tracking accuracy in Meta Quest headsets, limiting their effectiveness in precision-critical applications. Despite the growing use of haptic gloves in training simulators, teleoperation, and mixed reality (MR) interactions, there is no standardized methodology to benchmark the impact of glove material, shape, and construction on tracking stability. In this work, we introduce a two-stage experimental pipeline to evaluate glove-induced jitter and rotation drift using the built-in hand tracking of Meta Quest. We systematically assessed 10 hand configurations, nine types of gloves and a bare hand, using more than 20 repeated interaction trials each, resulting in more than 20,000 total jitter events. We supplement this with infrared image contrast analysis using a custom camera system calibrated to the Meta Quest sensor spectrum. Our findings demonstrate that well-designed glove patterns can outperform bare hands in tracking stability, with certain glove variants, such as ring-enhanced textile designs, exhibiting the lowest average jitter and drift. In contrast, commercial gloves such as TactGlove DK2 and our own early-stage haptic prototypes introduce significant tracking noise. These results offer practical design recommendations for future XR glove development and establish a robust benchmarking method for glove performance under real-world interaction scenarios.