Rates of cannabis use among adolescents are high, and are increasing concurrent with changes in the legal status of marijuana and societal attitudes regarding its use. Recreational cannabis use is understudied, especially in the adolescent period when neural maturation may make users particularly vulnerable to the effects of Δ-9-tetrahydrocannabinol (THC) on brain structure. In the current study, we used voxel-based morphometry to compare gray matter volume (GMV) in forty-six 14-year-old human adolescents (males and females) with just one or two instances of cannabis use and carefully matched THC-naive controls. We identified extensive regions in the bilateral medial temporal lobes as well as the bilateral posterior cingulate, lingual gyri, and cerebellum that showed greater GMV in the cannabis users. Analysis of longitudinal data confirmed that GMV differences were unlikely to precede cannabis use. GMV in the temporal regions was associated with contemporaneous performance on the Perceptual Reasoning Index and with future generalized anxiety symptoms in the cannabis users. The distribution of GMV effects mapped onto biomarkers of the endogenous cannabinoid system providing insight into possible mechanisms for these effects.