Software Quality in The Use-based Context: A Systematic Literature Review

Article Sidebar

PDF
Published: Oct 14, 2026
Keywords:
Software quality model Software quality in use Software product quality Software usability evaluation Systematic literature review

Main Article Content

Abstract

One crucial aspect to consider when measuring software quality is the use-based context. This approach allows for results that align with user needs. Measuring software quality within this context combines selected characteristics from Software Quality-in-Use (QiU) and Software Product Quality (PQ). However, there remains a limited body of literature on measuring software quality in this way. This study seeks to perform a Systematic Literature Review (SLR) to identify research trends, employed methodologies, and key findings from existing literature. The preparation and execution of this SLR adhered to the PRISMA guidelines. Our analysis included papers published between 2014 and 2024 from four digital library databases (Scopus, Science Direct, Springer, and Wiley), totaling 738 papers. After a thorough screening and eligibility assessment, we included 36 studies in our review. Our comprehensive analysis of previously conducted research revealed key findings related to the integration of software quality with Machine Learning (ML), Decision Support Systems (DSS), Goal-Question-Metric (GQM), and various implementation case studies. This focus offers a broader perspective on measuring software quality in the use-based context.

Downloads

Download data is not yet available.

Article Details

How to Cite
Rifai, M. F., Purwanto, P., & Nugraheni , D. M. K. (2026). Software Quality in The Use-based Context: A Systematic Literature Review. PETIR, 18(2). Retrieved from https://jurnal.itpln.ac.id/petir/article/view/2934
Issue
Vol. 18 No. 2 (2025): PETIR (Jurnal Pengkajian Dan Penerapan Teknik Informatika)
Section
Articles

References

S. Bernardo et al., “Software Quality Assurance as a Service: Encompassing the quality assessment of software and services,” Future Generation Computer Systems, vol. 156, no. February, pp. 254–268, 2024, doi: 10.1016/j.future.2024.03.024.

Z. A. Alzamil, “Software Coupling and Cohesion Model for Measuring the Quality of Software Components,” Computers, Materials and Continua, vol. 77, no. 3, pp. 3139–3161, 2023, doi: 10.32604/cmc.2023.042711.

T. Wahyuningrum and K. Mustofa, “A systematic mapping review of software quality measurement: Research trends, model, and method,” International Journal of Electrical and Computer Engineering, vol. 7, no. 5, pp. 2847–2854, 2017, doi: 10.11591/ijece.v7i5.pp2847-2854.

T. Galli, F. Chiclana, and F. Siewe, “Software Product Quality Models, Developments, Trends, and Evaluation,” SN Comput Sci, vol. 1, no. 3, pp. 1–24, 2020, doi: 10.1007/s42979-020-00140-z.

S. Aljarallah and R. Lock, “A Comparison of Software Quality Characteristics and Software Sustainability Characteristics,” ACM International Conference Proceeding Series, 2019, doi: 10.1145/3386164.3389078.

S. Kaur and P. Singh, “How does object-oriented code refactoring influence software quality? Research landscape and challenges,” Journal of Systems and Software, vol. 157, 2019, doi: 10.1016/j.jss.2019.110394.

A. A. Pratama and A. B. Mutiara, “Software Quality Analysis for Halodoc Application using ISO 25010:2011,” International Journal of Advanced Computer Science and Applications, vol. 12, no. 8, pp. 383–392, 2021, doi: 10.14569/IJACSA.2021.0120844.

L. Pinedo et al., “Software quality models: Exploratory review,” EAI Endorsed Transactions on Scalable Information Systems, vol. 10, no. 6, pp. 1–7, 2023, doi: 10.4108/eetsis.3982.

L. Souza-Pereira, S. Ouhbi, and N. Pombo, “Quality-in-use characteristics for clinical decision support system assessment,” Comput Methods Programs Biomed, vol. 207, p. 106169, 2021, doi: 10.1016/j.cmpb.2021.106169.

B. Gezici and A. K. Tarhan, “Systematic literature review on software quality for AI-based software,” Empir Softw Eng, vol. 27, no. 3, 2022, doi: 10.1007/s10664-021-10105-2.

D. Lizcano, A. L. Martínez-Ortiz, G. L. Gómez, and P. Smith, “Modelling web component quality using Delphi study: Abstract,” Comput Stand Interfaces, vol. 78, no. March, 2021, doi: 10.1016/j.csi.2021.103547.

D. Kato and H. Ishikawa, “Quality Control Methods Using Quality Characteristics in Development and Operations †,” Digital, vol. 4, no. 1, pp. 232–243, 2024, doi: 10.3390/digital4010012.

V. S. Barletta, D. Caivano, L. Colizzi, G. Dimauro, and M. Piattini, “Clinical-chatbot AHP evaluation based on ‘quality in use’ of ISO/IEC 25010,” Int J Med Inform, vol. 170, no. December 2022, p. 104951, 2023, doi: 10.1016/j.ijmedinf.2022.104951.

N. Bevan, “Quality in use: Meeting user needs for quality,” Journal of Systems and Software, vol. 49, no. 1, pp. 89–96, 1999, doi: 10.1016/S0164-1212(99)00070-9.

L. Canchari, P. Angeleri, and A. Dávila, “Requirements Validation in the Information System Software Development Lifecycle: A Software Quality in Use Evaluation,” Programming and Computer Software, vol. 49, no. 8, pp. 610–624, 2023, doi: 10.1134/S0361768823080054.

J. Merino, I. Caballero, B. Rivas, M. Serrano, and M. Piattini, “A Data Quality in Use model for Big Data,” Future Generation Computer Systems, vol. 63, pp. 123–130, 2016, doi: 10.1016/j.future.2015.11.024.

L. Souza-Pereira, N. Pombo, and S. Ouhbi, “Software quality: Application of a process model for quality-in-use assessment,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 7, pp. 4626–4634, 2022, doi: 10.1016/j.jksuci.2022.03.031.

I. Atoum, “A novel framework for measuring software quality-in-use based on semantic similarity and sentiment analysis of software reviews,” Journal of King Saud University - Computer and Information Sciences, vol. 32, no. 1, pp. 113–125, 2020, doi: 10.1016/j.jksuci.2018.04.012.

W. Perdomo and C. M. Zapata, “Software quality measures and their relationship with the states of the software system alpha,” Ingeniare, vol. 29, no. 2, pp. 346–363, 2021, doi: 10.4067/S0718-33052021000200346.

M. A. Talib, R. Alnanih, and A. Khelifi, “Application of quality in use model to assess the user experience of open source digital forensics tools,” International Journal of Electronic Security and Digital Forensics, vol. 12, no. 1, pp. 43–76, 2020, doi: 10.1504/IJESDF.2020.103870.

J. M. Ferreira et al., “Impact of usability mechanisms: An experiment on efficiency, effectiveness and user satisfaction,” Inf Softw Technol, vol. 117, no. September 2019, p. 106195, 2020, doi: 10.1016/j.infsof.2019.106195.

H. Del-Ángel-Flores, E. López-Domínguez, Y. Hernández-Velázquez, S. Domínguez-Isidro, M. A. Medina-Nieto, and J. De-La-Calleja, “Usability Evaluation of a Mobile Learning Platform Focused on Learning Monitoring and Customization based on a Laboratory Study,” Programming and Computer Software, vol. 48, no. 8, pp. 583–597, 2022, doi: 10.1134/S0361768822080102.

S. Galletta, S. Mazzù, V. Naciti, and A. Paltrinieri, “A PRISMA systematic review of greenwashing in the banking industry: A call for action,” Res Int Bus Finance, vol. 69, no. December 2023, p. 102262, 2024, doi: 10.1016/j.ribaf.2024.102262.

D. Tiara Kusuma, N. Ahmad, and S. Sakinah Syed Ahmad, “Clustering Algorithm for Electrical Load Profiling Analysis: a Systematic Review of Machine Learning Approaches for Improved Clustering Algorithms,” J Theor Appl Inf Technol, vol. 102, no. 10, pp. 5453–5468, 2024, [Online]. Available: www.jatit.org

A. Mishra and Z. Otaiwi, “DevOps and software quality: A systematic mapping,” Comput Sci Rev, vol. 38, p. 100308, 2020, doi: 10.1016/j.cosrev.2020.100308.

C. Yue, R. Huang, D. Towey, Z. Xian, and G. Wu, “An entropy-based group decision-making approach for software quality evaluation,” Expert Syst Appl, vol. 238, no. PC, p. 121979, 2024, doi: 10.1016/j.eswa.2023.121979.

B. El Fhel and A. Idri, “Quality In-Use of Mobile Geographic Information Systems for Data Collection,” International Journal of Advanced Computer Science and Applications, vol. 14, no. 11, pp. 903–913, 2023, doi: 10.14569/IJACSA.2023.0141192.

J. Sulla-Torres, A. Gutierrez-Quintanilla, H. Pinto-Rodriguez, R. Gómez-Campos, and M. Cossio-Bolaños, “Quality in use of an android-based mobile application for calculation of bone mineral density with the standard ISO/IEC 25022,” International Journal of Advanced Computer Science and Applications, vol. 11, no. 8, pp. 158–163, 2020, doi: 10.14569/IJACSA.2020.0110821.

B. I. Belinda, A. A. Emmanuel, N. Solomon, and A. B. Kayode, “Evaluating Software Quality Attributes using Analytic Hierarchy Process (AHP),” International Journal of Advanced Computer Science and Applications, vol. 12, no. 3, pp. 165–173, 2021, doi: 10.14569/IJACSA.2021.0120321.

N. Kipkurui, P. G., and A. Ikoha, “Evaluating Usability of E-Learning Systems in Universities,” International Journal of Advanced Computer Science and Applications, vol. 5, no. 8, 2014, doi: 10.14569/ijacsa.2014.050815.

S. Salomón, R. Duque, J. L. Montaña, and L. Tenés, “Towards automatic evaluation of the Quality-in-Use in context-aware software systems,” J Ambient Intell Humaniz Comput, vol. 14, no. 8, pp. 10321–10346, 2023, doi: 10.1007/s12652-021-03693-w.

Y. Thamilarasan, R. R. Raja Ikram, M. Osman, L. Salahuddin, W. Y. Wan Bujeri, and K. Kanchymalay, “Enhanced System Usability Scale using the Software Quality Standard Approach,” Engineering, Technology and Applied Science Research, vol. 13, no. 5, pp. 11779–11784, 2023, doi: 10.48084/etasr.5971.

K. Moumane and A. Idri, “ISO / IEC 25010- based Quality evaluation of three mobile applications for reproductive health services in Morocco,” Clin Exp Obstet Gynecol, 2023, doi: 10.21203/rs.3.rs-2720323/v1.

L. Souza-Pereira, S. Ouhbi, and N. Pombo, “A process model for quality in use evaluation of clinical decision support systems,” J Biomed Inform, vol. 123, no. September, p. 103917, 2021, doi: 10.1016/j.jbi.2021.103917.

M. Abu Talib, A. Alsaafin, and S. M. Medjden, “Application of Quality in Use Model to Evaluate the User Experience of Online Banking Software,” Journal of Cases on Information Technology, vol. 22, no. 2, pp. 34–51, 2020, doi: 10.4018/JCIT.2020040103.

R. Capilla, R. Kazman, C. Romera, and C. Carrillo, “Usability implications in software architecture: The case study of a mobile app,” Softw Pract Exp, vol. 50, no. 12, pp. 2145–2168, 2020, doi: 10.1002/spe.2883.

S. Fukuzumi, N. Hirasawa, N. Wada, T. Komiyama, and M. Azuma, “Proposal of Quality in Use in Software Quality,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer, 2020, pp. 431–438. doi: 10.1007/978-3-030-49059-1_31.

T. Komiyama, S. Fukuzumi, M. Azuma, H. Washizaki, and N. Tsuda, “Usability of Software–Intensive Systems from Developers’ Point of View: Current Status and Future Perspectives of International Standardization of Usability Evaluation,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer, 2020, pp. 450–463. doi: 10.1007/978-3-030-49059-1_33.

S. H. Kim and W. J. Kim, “Evaluation of software quality-in-use attributes based on analysis network process,” Cluster Comput, vol. 22, pp. 2101–2114, Jan. 2019, doi: 10.1007/s10586-018-2309-6.

C. Cuerda et al., “Usability Evaluation of a Distributed User Interface Application for Visuomotor Organization Assessment,” Methods Inf Med, vol. 59, no. 3, pp. E79–E89, Nov. 2019, doi: 10.1055/s-0040-1713086.

O. Alshareet, A. Itradat, I. A. Doush, and A. Quttoum, “Incorporation of ISO 25010 with machine learning to develop a novel quality in use prediction system (QiUPS),” International Journal of System Assurance Engineering and Management, vol. 9, no. 2, pp. 344–353, 2018, doi: 10.1007/s13198-017-0649-x.

Jocelyn O. Balolot, “Web-based Management Information System with Data Visualization,” in 2024 5th International Conference on Image Processing and Capsule Networks (ICIPCN), IEEE, 2024. doi: 10.1109/ICIPCN63822.2024.00100.

Fadilah Nurunnisa; Angraini; Muhammad Luthfi Hamzah; Eki Saputra, “Analyzing the Quality of Web-Based Scholarship Information System Using ISO/IEC 25010 Standard,” in 2024 International Conference on Circuit, Systems and Communication (ICCSC), IEEE, 2024. doi: 10.1109/ICCSC62074.2024.10617354.

D. L. Yonia, R. N. E. Anggraini, R. Sarno, A. T. Haryono, A. F. Septiyanto, and S. Mulyanto, “E-Learning Evaluation Using Information Technology Infrastructure Library 4 with ISO/IEC 25010 Indicators,” in International Conference on Artificial Intelligence and Mechatronics System, AIMS 2024, Institute of Electrical and Electronics Engineers Inc., 2024. doi: 10.1109/AIMS61812.2024.10512570.

W. Purbaratri, K. D. Hartomo, Hendry, and J. J. C. Tambotoh, “The New Smart Government Software Quality Framework Uses Modifications to ISO/IEC 25010,” in 2023 8th International Conference on Informatics and Computing, ICIC 2023, Institute of Electrical and Electronics Engineers Inc., 2023. doi: 10.1109/ICIC60109.2023.10382109.

B. R. Awangditama, L. Mardhatillah, and S. Rochimah, “Quality Conformity Analysis Functional and Usability in Academic Information Systems Using ISO/IEC 25010,” in 2023 14th International Conference on Information and Communication Technology and System, ICTS 2023, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 24–28. doi: 10.1109/ICTS58770.2023.10330881.

I. M. S. Bimantara and S. Rochimah, “Usability Characteristics Evaluation on Food Delivery Service Applications using ISO/IEC 25010 Quality Model,” in 2023 14th International Conference on Information and Communication Technology and System, ICTS 2023, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 1–6. doi: 10.1109/ICTS58770.2023.10330853.

G. M. I. Alcober, A. J. M. Rubio, J. P. Lazaro, J. B. Mangaba, H. D. A. Balmeo, and T. F. Revano, “TISSA: A Web-based Helpdesk Support System for Tertiary Institutions with Knowledge-based Management and Ticket Forecasting using Time Series Methods,” in 2022 IEEE 14th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management, HNICEM 2022, Institute of Electrical and Electronics Engineers Inc., 2022. doi: 10.1109/HNICEM57413.2022.10109478.

J. Z. Tellington, R. A. Banderlipe, J. M. Nuqui, J. Flores, and A. Malicdem, “UMatter: A Mobile Application to Help Mitigate Depression,” in Proceedings - 2022 2nd International Conference in Information and Computing Research, iCORE 2022, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 164–169. doi: 10.1109/iCORE58172.2022.00049.

F. Ihirwe, D. Di Ruscio, S. Gianfranceschi, and A. Pierantonio, “Assessing the Quality of Low-Code and Model-Driven Engineering Platforms for Engineering IoT Systems,” in IEEE International Conference on Software Quality, Reliability and Security, QRS, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 583–594. doi: 10.1109/QRS57517.2022.00065.

Irawan Y. I; Negara E. S., “Evaluation of Software Quality Assurance Silampari Smart City Of Lubuklinggau Based On ISO/IEC 25010:2011 Analysis Model,” in International Conference on Informatics, Multimedia, Cyber and Information System, ICIMCIS 2022, 2022. doi: https://dx.doi.org/10.1109/ICIMCIS56303.2022.10017834.

Sholiq, R. A. Auda, A. P. Subriadi, A. Tjahyanto, and A. D. Wulandari, “Measuring software quality with usability, efficiency, and portability characteristics,” IOP Conf Ser Earth Environ Sci, vol. 704, no. 1, 2021, doi: 10.1088/1755-1315/704/1/012039.

K. Slhoub, F. Nembhard, and M. Carvalho, “A Metrics Tracking Program for Promoting High-Quality Software Development,” Conference Proceedings - IEEE SOUTHEASTCON, vol. 2019-April, no. April, 2019, doi: 10.1109/SoutheastCon42311.2019.9020395.

H. Hashemi Farzaneh and L. Neuner, “Usability evaluation of software tools for engineering design,” Proceedings of the International Conference on Engineering Design, ICED, vol. 2019-Augus, no. AUGUST, pp. 1303–1312, 2019, doi: 10.1017/dsi.2019.136.