Environmental noise is known to affect personal well-being as well as cognitive processes. Besides daily life, environmental noise can also occur in experimental research settings, e.g. when being in a magnetic resonance scanner. Scanner background noise (SBN) might pose serious confounds for experimental findings, even when non-auditory settings are examined. In the current experiment we tested if SBN alters bottom-up and top-down related processes of selective visual attention mechanisms. Participants completed two blocks of a visual change detection task, one block in silence and one block under SBN exposure. SBN was found to decrease accuracy in measures of visual attention. This effect was modulated by the temporal occurrence of SBN. When SBN was encountered in the first block, it prevented a significant improvement of accuracy in the second block. When SBN appeared in the second block, it significantly decreased accuracy. Neurophysiological findings showed a strong frontal positivity shift only when SBN was present in the first block, suggesting an inhibitory process to counteract the interfering SBN. Common correlates of both top-down and bottom-up processes of selective visual attention were not specifically affected by SBN exposure. Further research appears necessary to entirely rule out confounds of SBN in assessing visual attention.