Among youths with conduct disorder, those with callous-unemotional traits are at increased risk for persistent antisocial behaviour. Although callous-unemotional traits have been found to be associated with white-matter brain abnormalities, previous diffusion imaging studies were conducted in small samples, preventing examination of potential sex by callous-unemotional traits interaction effects on white matter. Here, we used tract-based spatial statistics at a whole-brain level and within regions of interest to compare the white matter correlates of callous-unemotional traits in female vs. male youths with conduct disorder, in a sample (n = 124) recruited through a multi-site protocol. A sex-specific association between callous-unemotional traits and white matter was found in the left uncinate fasciculus, where callous-unemotional traits were positively associated with axial diffusivity in males, while an opposite pattern was found in females. These findings are in line with previous studies suggesting that the uncinate fasciculus is a key tract implicated in the development of psychopathy, but also add to recent evidence showing that sexual dimorphism needs to be taken into account when examining the structural correlates of mental disorders in general, and callous-unemotional traits in conduct disorder in particular.