Transparent Quality Optimization for Machine Learning-Based Regression in Neurology
Research output: Contribution to journal › Research article › Contributed › peer-review
Contributors
Abstract
The clinical monitoring of walking generates enormous amounts of data that contain extremely valuable information. Therefore, machine learning (ML) has rapidly entered the research arena to analyze and make predictions from large heterogeneous datasets. Such data-driven ML-based applications for various domains become increasingly applicable, and thus their software qualities are taken into focus. This work provides a proof of concept for applying state-of-the-art ML technology to predict the distance travelled of the 2-min walk test, an important neurological measurement which is an indicator of walking endurance. A transparent lean approach was emphasized to optimize the results in an explainable way and simultaneously meet the specified software requirements for a generic approach. It is a general-purpose strategy as a fractional–factorial design benchmark combined with standardized quality metrics based on a minimal technology build and a resulting optimized software prototype. Based on 400 training and 100 validation data, the achieved prediction yielded a relative error of 6.1% distributed over multiple experiments with an optimized configuration. The Adadelta algorithm (LR = 0.000814, f ModelSpread = 5, n ModelDepth = 6, n epoch = 1000) performed as the best model, with 90% of the predictions with an absolute error of <15 m. Factors such as gender, age, disease duration, or use of walking aids showed no effect on the relative error. For multiple sclerosis patients with high walking impairment (EDSS Ambulation Score ≥ 6), the relative difference was significant (n = 30; 24.0%; p < 0.050). The results show that it is possible to create a transparently working ML prototype for a given medical use case while meeting certain software qualities.
Details
Original language | English |
---|---|
Article number | 908 |
Number of pages | 13 |
Journal | Journal of Personalized Medicine : open access journal |
Volume | 12 |
Issue number | 6 |
Publication status | Published - 31 May 2022 |
Peer-reviewed | Yes |
External IDs
Scopus | 85132308159 |
---|---|
PubMed | 35743693 |
WOS | 000816692600001 |
Mendeley | ebe2c782-2974-3754-addd-3541bfbfb1c0 |
unpaywall | 10.3390/jpm12060908 |
ORCID | /0000-0002-3513-6448/work/168720173 |
ORCID | /0000-0001-8799-8202/work/171553372 |
Keywords
Sustainable Development Goals
ASJC Scopus subject areas
Keywords
- deep learning, fractional factorial design benchmark, inertial measurement units, machine learning, multiple sclerosis, software quality