While it is well known that the left hemisphere is more efficient than the right in most tasks involving perception of speech stimuli, the neurophysiological pathways leading to these lateralised performance differences are as yet rather unclear. In particular, the question whether language lateralisation depends on semantic processing or is already evident in early perceptual stimulus processing has not been answered unequivocally. In the present study, we therefore recorded event-related potentials (ERPs) during tachistoscopic presentation of horizontally or vertically presented verbal stimuli in the left (LVF) and the right visual field (RVF). Participants were asked to indicate, whether the presented stimulus was a word or a non-word. On the behavioural level, participants showed stronger hemispheric asymmetries for horizontal, than for vertical stimulus presentation. In addition, ERP asymmetries were also modulated by stimulus presentation format, as the electrode by visual field interactions for P1 and N1 were stronger after vertical, than after horizontal stimulus presentation. Moreover, sLORETA revealed that ERP left-right asymmetries were mainly driven by the extrastriate cortex and reading-associated areas in the parietal cortex. Taken together, the present study shows electrophysiological support for the assumption that language lateralisation during speech perception arises from a left dominance for the processing of early perceptual stimulus aspects.