Automated Motor Tic Detection: A Machine Learning Approach

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Nele Sophie Brügge - , University of Lübeck, German Research Center for Artificial Intelligence (Author)
  • Gesine Marie Sallandt - , Universitätsklinikum Schleswig-Holstein - Campus Lübeck, University of Economics in Katowice (Author)
  • Ronja Schappert - , Universitätsklinikum Schleswig-Holstein - Campus Lübeck (Author)
  • Frédéric Li - , University of Lübeck (Author)
  • Alina Siekmann - , Universitätsklinikum Schleswig-Holstein - Campus Lübeck (Author)
  • Marcin Grzegorzek - , University of Lübeck, Trier University (Author)
  • Tobias Bäumer - , Universitätsklinikum Schleswig-Holstein - Campus Lübeck (Author)
  • Christian Frings - , Department of Child and Adolescent Psychiatry and Psychotherapy (Author)
  • Christian Beste - , Department of Child and Adolescent Psychiatry and Psychotherapy, Shandong Normal University, University of Lübeck (Author)
  • Roland Stenger - , University of Lübeck (Author)
  • Veit Roessner - , Department of Child and Adolescent Psychiatry and Psychotherapy (Author)
  • Sebastian Fudickar - , University of Lübeck (Author)
  • Heinz Handels - , University of Lübeck, German Research Center for Artificial Intelligence (Author)
  • Alexander Münchau - , Universitätsklinikum Schleswig-Holstein - Campus Lübeck (Author)

Abstract

Background: Video-based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time-consuming and cumbersome, particularly in large-scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection. Objective: The aim of this study was to evaluate the performances of state-of-the-art ML approaches for automatic video-based tic detection in patients with Tourette syndrome. Methods: We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no-tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network). Results: Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach. Conclusions: ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics.

Details

Original languageEnglish
Pages (from-to)1327-1335
Number of pages9
JournalMovement disorders
Volume38 (2023)
Issue number7
Publication statusPublished - 11 May 2023
Peer-reviewedYes

External IDs

PubMed 37166278
ORCID /0000-0002-2989-9561/work/146788813
WOS 000985902300001

Keywords

ASJC Scopus subject areas

Keywords

  • deep neural networks, Face Mesh, machine learning, Random Forest, tic detection, Tourette syndrome, Tic detection, Deep neural networks, Machine learning, Tics/diagnosis, Reproducibility of Results, Humans, Tourette Syndrome/diagnosis, Machine Learning, Tic Disorders/diagnosis

Library keywords