CHALLENGES OF MLOPS ADOPTION IN SMALL-SCALE ORGANIZATIONS: A SYSTEMATIC LITERATURE REVIEW AND IMPLICATIONS FOR INDONESIA
DOI:
https://doi.org/10.54314/rkskc803Keywords:
MLOps, small organizations, MSMEs, TOE framework, systematic literature reviewAbstract
Abstract: MLOps is the practice of deploying and managing machine learning models within organizations. Most research assumes access to substantial resources. This study maps adoption challenges in small organizations and teams with limited resources and develops a research agenda for Indonesian MSMEs and startups. A systematic literature review followed Kitchenham and Charters’ guidelines and PRISMA 2020 reporting standards. Searches across nine sources, supplemented by snowballing, identified 28 studies that met the selection and quality criteria. Eight challenge categories emerged. The most frequently reported concerned data readiness and management, skills shortages, and complex processes and tools. These challenges were mapped to the Technology-Organization-Environment (TOE) framework. Technology and organizational issues dominated, while external factors received less attention. Proposed strategies include gradual adoption guided by simple maturity models, open-source software, and step-by-step automation. For Indonesian MSMEs, practical priorities concern AI expertise, cloud computing costs, and data readiness. The study provides a classification of challenges for resource-constrained organizations and a research agenda that can guide further work.
Keyword: MLOps; small organizations; MSMEs; TOE framework; systematic literature review
Abstrak: MLOps merupakan praktik untuk menerapkan dan mengelola model pembelajaran mesin dalam kegiatan organisasi. Sebagian besar penelitian tentang praktik ini mengasumsikan organisasi memiliki sumber daya besar. Penelitian ini memetakan tantangan penerapannya pada organisasi kecil dan tim dengan sumber daya terbatas, lalu menyusun agenda penelitian bagi UMKM dan startup Indonesia. Penelitian menggunakan tinjauan pustaka sistematis berdasarkan panduan Kitchenham dan Charters serta pelaporan PRISMA 2020. Pencarian pada sembilan sumber dilengkapi penelusuran artikel yang saling merujuk (snowballing), menghasilkan 28 studi yang memenuhi kriteria pemilihan dan penilaian kualitas. Masalah yang sering dilaporkan ialah kesiapan dan pengelolaan data, kekurangan tenaga ahli, serta kerumitan proses dan perangkat yang digunakan. Tantangan tersebut dipetakan melalui kerangka Technology Organization Environment (TOE), yang mencakup teknologi, organisasi, dan faktor di luar organisasi. Pembahasan lebih banyak berfokus pada teknologi dan organisasi; faktor luar masih kurang dikaji. Strategi yang diusulkan mencakup penerapan bertahap berdasarkan model kematangan sederhana sebagai panduan pengembangan kemampuan organisasi, penggunaan perangkat lunak dengan kode sumber terbuka, dan otomatisasi sedikit demi sedikit. Bagi UMKM Indonesia, perhatian diarahkan pada ketersediaan tenaga ahli AI, biaya layanan komputasi awan (cloud), dan kesiapan data. Hasil penelitian berupa pengelompokan tantangan bagi organisasi dengan sumber daya terbatas serta agenda penelitian yang dapat dilaksanakan.
Kata kunci: MLOps; organisasi kecil; UMKM; kerangka TOE; systematic literature review
Downloads
References
Aligarh, F., Sutopo, B., & Widarjo, W. (2023). The antecedents of cloud computing adoption and its consequences for MSMEs’ performance: A model based on the Technology-Organization-Environment (TOE) framework. Cogent Business & Management, 10(2), Article 2220190. https://doi.org/10.1080/23311975.2023.2220190
Amrit, C., & Narayanappa, A. K. (2025). An analysis of the challenges in the adoption of MLOps. Journal of Innovation & Knowledge, 10(1), Article 100637. https://doi.org/10.1016/j.jik.2024.100637
Cahyadi, L. D. C. R., & Pradnyani, N. L. P. S. P. (2022). Digitalisasi UMKM dengan menggunakan pendekatan TOE model. E-Jurnal Ekonomi dan Bisnis Universitas Udayana, 11(9), 1132–1140. https://doi.org/10.24843/eeb.2022.v11.i09.p10
Calefato, F., Lanubile, F., & Quaranta, L. (2022). A preliminary investigation of MLOps practices in GitHub. In Proceedings of the 16th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement (pp. 283–288). Association for Computing Machinery. https://doi.org/10.1145/3544902.3546636
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
Diaz-de-Arcaya, J., Torre-Bastida, A. I., Zárate, G., Miñón, R., & Almeida, A. (2024). A joint study of the challenges, opportunities, and roadmap of MLOps and AIOps: A systematic survey. ACM Computing Surveys, 56(4), Article 84. https://doi.org/10.1145/3625289
Google, Temasek, & Bain & Company (2024). e-Conomy SEA 2024. https://services.google.com/fh/files/misc/indonesia_e_conomy_sea_2024_report.pdf
Hasan, A. N., Liwan, N. A., Sudharma, F. Z., Pontoh, G. T., & Indrijawati, A. (2025). Adopsi cloud enterprise resource planning dengan pendekatan technology, organization, and environmental pada UMKM: Tinjauan literatur. EL MUHASABA: Jurnal Akuntansi, 16(1), 45–63. https://doi.org/10.18860/em.v16i1.26819
Hopkins, A., & Booth, S. (2021). Machine learning practices outside Big Tech: How resource constraints challenge responsible development. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society (pp. 134–145). Association for Computing Machinery. https://doi.org/10.1145/3461702.3462527
John, M. M., Gillblad, D., Olsson, H. H., & Bosch, J. (2023). Advancing MLOps from ad hoc to Kaizen. In 2023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) (pp. 94–101). IEEE. https://doi.org/10.1109/seaa60479.2023.00023
John, M. M., Olsson, H. H., & Bosch, J. (2021). Towards MLOps: A framework and maturity model. In 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) (pp. 1–8). IEEE. https://doi.org/10.1109/seaa53835.2021.00050
John, M. M., Olsson, H. H., & Bosch, J. (2025). An empirical guide to MLOps adoption: Framework, maturity model and taxonomy. Information and Software Technology, 183, Article 107725. https://doi.org/10.1016/j.infsof.2025.107725
Karamitsos, I., Thabit, S., & Apostolopoulos, C. (2020). Applying DevOps practices of continuous automation for machine learning. Information, 11(7), Article 363. https://doi.org/10.3390/info11070363
Katz, R., Jung, J., Beschorner, N., Morgan, P. J., Beirne, J., & Rahut, D. B. (2024). Cloud computing policies and their economic impacts in Asia and the Pacific (ADBI Policy Brief No. 2024-1). Asian Development Bank Institute. https://doi.org/10.56506/RDQI5446
Kementerian Komunikasi dan Digital (2025). Laporan kinerja Kementerian Komdigi 2024. https://eppid.komdigi.go.id/attachments/149e1e651bbadbaf0a2ed80b0be453a0670d4cdbf61b70f377a989d144cbad6e/055c89fe9b532767a524481e9df16711c5071adb1c24c6cd024e30d5a08429f5.pdf
Kementerian UMKM Republik Indonesia (2025, February 25). Data kontribusi UMKM terhadap PDB 2024 [Pernyataan Deputi Bidang Usaha Mikro].
Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering (EBSE Technical Report EBSE-2007-01, Version 2.3). Keele University & University of Durham. https://ebse.webspace.durham.ac.uk/ebse-bibliography/guidelines-for-performing-systematic-literature-reviews-in-software-engineering/
Kolltveit, A. B., & Li, J. (2022). Operationalizing machine learning models: A systematic literature review. In Proceedings of the 1st Workshop on Software Engineering for Responsible AI (pp. 1–8). Association for Computing Machinery.https://doi.org/10.1145/3526073.3527584
Kreuzberger, D., Kühl, N., & Hirschl, S. (2023). Machine learning operations (MLOps): Overview, definition, and architecture. IEEE Access, 11, 31866–31879. https://doi.org/10.1109/access.2023.3262138
Lima, A., Monteiro, L., & Furtado, A. P. (2022). MLOps: Practices, maturity models, roles, tools, and challenges—A systematic literature review. In Proceedings of the 24th International Conference on Enterprise Information Systems (Vol. 2, pp. 308–320). SCITEPRESS. https://doi.org/10.5220/0010997300003179
Mäkinen, S., Skogström, H., Laaksonen, E., & Mikkonen, T. (2021). Who needs MLOps: What data scientists seek to accomplish and how can MLOps help? In 2021 IEEE/ACM 1st Workshop on AI Engineering - Software Engineering for AI (WAIN) (pp. 109–112). IEEE. https://doi.org/10.1109/wain52551.2021.00024
Mboweni, T., Masombuka, T., & Dongmo, C. (2022). A systematic review of machine learning DevOps. In 2022 International Conference on Electrical, Computer and Energy Technologies (ICECET) (pp. 1–6). IEEE. https://doi.org/10.1109/icecet55527.2022.9872968
Naufalrafa, S., Hidayah, Q. H., Ariessanti, H. D., & Wahyu, S. (2025). Studi kesiapan digital pada UMKM kecil di Jakarta Barat menggunakan TOE framework. Jurnal Ilmiah Sistem Informasi dan Ilmu Komputer, 5(3), 342–357. https://doi.org/10.55606/juisik.v5i3.1677
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, Article n71. https://doi.org/10.1136/bmj.n71
Paleyes, A., Urma, R.-G., & Lawrence, N. D. (2023). Challenges in deploying machine learning: A survey of case studies. ACM Computing Surveys, 55(6), Article 114. https://doi.org/10.1145/3533378
Recupito, G., Pecorelli, F., Catolino, G., Moreschini, S., Di Nucci, D., Palomba, F., & Tamburri, D. A. (2022). A multivocal literature review of MLOps tools and features. In 2022 48th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) (pp. 84–91). IEEE. https://doi.org/10.1109/seaa56994.2022.00021
Rogers, E. M. (2003). Diffusion of innovations (5th ed.). Free Press.
Ruf, P., Madan, M., Reich, C., & Ould-Abdeslam, D. (2021). Demystifying MLOps and presenting a recipe for the selection of open-source tools. Applied Sciences, 11(19), Article 8861. https://doi.org/10.3390/app11198861
Ruslaini, Kasih, E. W., & Santoso, S. (2024). Kajian literatur adopsi cloud computing pada UMKM: Perspektif strategis dan dinamika dalam satu dekade. Jurnal Visi Manajemen, 10(3), 231–245. https://doi.org/10.56910/jvm.v10i3.526
Sculley, D., Holt, G., Golovin, D., Davydov, E., Phillips, T., Ebner, D., Chaudhary, V., Young, M., Crespo, J.-F., & Dennison, D. (2015). Hidden technical debt in machine learning systems. In Advances in neural information processing systems (Vol. 28, pp. 2503–2511). https://proceedings.neurips.cc/paper_files/paper/2015/hash/86df7dcfd896fcaf2674f757a2463eba-Abstract.html
Setiyani, L., & Rostiani, Y. (2021). Analysis of e-commerce adoption by SMEs using the Technology–Organization–Environment (TOE) model: A case study in Karawang, Indonesia. International Journal of Science, Technology & Management, 2(4), 1113–1132. https://doi.org/10.46729/ijstm.v2i4.246
Shankar, S., Garcia, R., Hellerstein, J. M., & Parameswaran, A. G. (2024). “We have no idea how models will behave in production until production”: How engineers operationalize machine learning. Proceedings of the ACM on Human-Computer Interaction, 8(CSCW1), Article 206. https://doi.org/10.1145/3653697
Singla, A. (2023). Machine learning operations (MLOps): Challenges and strategies. Journal of Knowledge Learning and Science Technology, 2(3), 333–340. https://doi.org/10.60087/jklst.vol2.n3.p340
Symeonidis, G., Nerantzis, E., Kazakis, A., & Papakostas, G. A. (2022). MLOps—Definitions, tools and challenges. In 2022 IEEE 12th Annual Computing and Communication Workshop and Conference (CCWC) (pp. 0453–0460). IEEE. https://doi.org/10.1109/ccwc54503.2022.9720902
Tamburri, D. A. (2020). Sustainable MLOps: Trends and challenges. In 2020 22nd International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) (pp. 17–23). IEEE. https://doi.org/10.1109/synasc51798.2020.00015
Testi, M., Ballabio, M., Frontoni, E., Iannello, G., Moccia, S., Soda, P., & Vessio, G. (2022). MLOps: A taxonomy and a methodology. IEEE Access, 10, 63606–63618. https://doi.org/10.1109/access.2022.3181730
Tornatzky, L. G., & Fleischer, M. (1990). The processes of technological innovation. Lexington Books.
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540
Zarour, M., Alzabut, H., & Al-Sarayreh, K. T. (2025). MLOps best practices, challenges and maturity models: A systematic literature review. Information and Software Technology, 183, Article 107733. https://doi.org/10.1016/j.infsof.2025.107733
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Franky Gerald Cliford Manoppo, Hosea Gian Kaunang, Billy Josef Waworuntu (Author)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
