People are exposed to noise and vibrations in many situations simultaneously. Particularly at work places of machine drivers both noise and vibration immissions at critical levels occur frequently. Simultaneous exposure of sound and vibration leads to a complex stimulus that is perceived with multiple senses. To investigate the annoyance, caused by such a multimodal perception event, measurements in street sweeping vehicles were carried out. On this basis, scenes at different sound and whole-body vibration levels were presented to the subjects in a perception experiment and rated with regard to their annoyance. The participants' ratings deliver detailed knowledge about the influence of both stimuli's strength and their interaction. With the participants' ratings, insights about the influence of both stimuli's strength and their interaction were gained.