Task switching is regularly required in our everyday life. To succeed in switching, it is important to inhibit the most recently performed task and instead activate the currently relevant task. The process that inhibits a recently performed task when a new task is to be performed is referred to as ‘backward inhibition’ (BI). While the BI effect has been subject to intense research in cognitive psychology, little is known about the neuronal mechanisms that are related to the BI effect and those that relate to differences in the magnitude of the BI effect. In the current study, we examined the system neurophysiological basis of BI processes using event-related potentials (ERPs) and sLORETA by also taking inter-individual differences in the magnitude of the BI into account. The results suggest that BI processes and inter-individual differences in them strongly depend upon attentional selection mechanisms (reflected by N1-ERP modulations in the current task/trial) mediated via networks consisting of extrastriate occipital areas, the temporo-parietal junction and the inferior frontal gyrus. Other processes and mechanisms related to conflict monitoring, response selection, or the updating, organization and implementation of a new task-set (i.e. N2 and P3 processes) were not shown to be modulated by BI processes and differences in their magnitude, as evoked with a common BI paradigm.