Autism Spectrum Disorder (ASD) is generally associated with difficulties in contextual source memory but not single item memory. There are surprising inconsistencies in the literature, however, that the current study seeks to address by examining item and source memory in age and ability matched groups of 22 ASD and 21 comparison adults. Results show that group differences in source memory are moderated by task demands but not by individual differences in verbal ability, executive function or item memory. By contrast, unexpected group differences in item memory could largely be explained by individual differences in source memory. These observations shed light on the factors underlying inconsistent findings in the memory literature in ASD, which has important implications for theory and practice.