A Pipeline for the Creation of Multimodal Corpora from YouTube Videos

Research output: Contribution to conferencesPaperContributedpeer-review

Contributors

Abstract

This paper introduces an open-source pipeline for the creation of multimodal corpora from YouTube videos. It minimizes storage and bandwidth requirements, because the videos themselves need not be downloaded and can remain on YouTube's servers. It also minimizes processing requirements by using YouTube's automatically generated subtitles, thus avoiding a computationally expensive automatic speech recognition processing step. The pipeline combines standard tools and provides as its output a corpus file in the industry-standard vertical format used by many corpus managers. It is straightforwardly extensible with the addition of further levels of annotation and can be adapted to languages other than English.

Details

Original languageEnglish
Pages1-5
Number of pages5
Publication statusPublished - 2023
Peer-reviewedYes

Workshop

Title1st Workshop on Linguistic Insights from and for Multimodal Language Processing
Abbreviated titleLIMO 2023
Conference number1
DescriptionCo-located with KONVENS 2023 (Konferenz zur Verarbeitung natürlicher Sprache/Conference on Natural Language Processing)
Duration22 September 2023
Website
LocationTechnische Hochschule Ingolstadt
CityIngolstadt
CountryGermany

Keywords