Biased motion of motile cells in a concentration gradient of a chemoattractant is frequently studied on the population level. This approach has been particularly employed in human sperm chemotactic assays, where the fraction of responsive cells is low and detection of biased motion depends on subtle differences. In these assays, statistical measures such as population odds ratios of swimming directions can be employed to infer chemotactic performance. Here, we report on an improved method to assess statistical significance of experimentally determined odds ratios and discuss the strong impact of data correlations that arise from the directional persistence of sperm swimming.