A Comparative Analysis of Industrial MLOps prototype for ML Application Deployment at the edge devices

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Abstract

This paper introduces a prototype for constructing an edge AI system utilizing the contemporary Machine Learning Operations (MLOps) concept. By employing micro-controllers such as the Rasp-berry Pi as hardware, our methodology includes data scrubbing and machine learning model deployment on edge devices. Crucially, the MLOps pipeline is fully developed within the ecoKI plat-form, a research platform for ML/AI applications. In this study, we thoroughly investigate the performance of our ecoKI platform by comparing it with the established Edge Impulse platform. We deployed the ML model with different weight quantization methods, such as FP32 and INT8, to compare accuracy variations and inference speed between these two platforms and quantization strategies on edge devices. In our experiments, we identified that the average accuracy performance of the ecoKI platform is 3.61% better than the edge impulse. Moreover, real-time AI processing on edge devices enables micro-controllers, even those with limited resources, to effectively handle tasks in areas such as predictive maintenance, process optimization, quality assurance, and supply chain management.

Details

Original languageEnglish
Title of host publicationProceedings of the 35th European Symposium on Computer Aided Process Engineering (ESCAPE)
PublisherPSE Press
Pages1878-1883
Number of pages6
ISBN (print)978-1-7779403-3-1
Publication statusPublished - 1 Jul 2025
Peer-reviewedYes

Publication series

SeriesSystems and Control Transactions
Volume4
ISSN2818-4734

External IDs

ORCID /0000-0003-3753-3778/work/187559905
ORCID /0000-0001-5165-4459/work/187562742
ORCID /0000-0003-3368-4130/work/187563367
Mendeley 5f3c7c93-5a04-3e2c-9fe4-94a0a256626b

Keywords

Keywords

  • Artificial Intelligence, Industry 4.0, Energy Efficiency, Machine Learning, Big Data, Edge Intelligence