Standardizing UX Dashboards: A Framework Integrating Usability Metrics, Benchmarks, and Glossaries for Managerial Insight
DOI:
https://doi.org/10.61978/data.v2i1.927Keywords:
User Experience, UX Dashboard, Usability Metrics, ISO 9241 11, Core Web Vitals, Benchmark Analysis, UX Evaluation, Design StandardsAbstract
User experience (UX) dashboards serve as essential tools for translating complex digital interaction data into strategic business insights. This study aims to construct a comprehensive dashboard framework by integrating international usability standards, validated public benchmarks, and a structured glossary of UX metrics. Drawing upon ISO 9241 11, ISO/IEC 25010, the HEART framework, and benchmark data from sources like CrUX, Mixpanel, and Baymard Institute, the proposed model categorizes UX metrics into subjective (e.g., SUS, UMUX Lite), behavioral (e.g., DAU/MAU), and technical (e.g., LCP, INP, CLS) dimensions. The study applies a structured classification of metrics grounded in usability standards and validated benchmarks. Key findings highlight benchmark and glossary tables that consolidate formulas, interpretation guidelines, and sector averages. For instance, SUS scores above 68 and UMUX Lite above 70 indicate acceptable usability, while Core Web Vitals thresholds remain critical. The framework offers practical guidance for consistent and real-time UX evaluations and supports future empirical validation.
References
Afriansyah, A., Walhidayat, W., Novendra, R., Harefa, L., & Sutejo, S. (2022). Usability Testing on Tracer Study System Using the Heuristic Evaluation Method. Journal of Applied Engineering and Technological Science (Jaets), 3(2), 178–184. https://doi.org/10.37385/jaets.v3i2.807 DOI: https://doi.org/10.37385/jaets.v3i2.807
Agarwal, P., Gordon, D., Griffith, J., Kithulegoda, N., Witteman, H. O., Bhatia, R. S., Kushniruk, A., Borycki, E. M., Lamothe, L., Springall, E., & Shaw, J. (2021). Assessing the Quality of Mobile Applications in Chronic Disease Management: A Scoping Review. NPJ Digital Medicine, 4(1). https://doi.org/10.1038/s41746-021-00410-x DOI: https://doi.org/10.1038/s41746-021-00410-x
Alhasani, R., George, N., Radman, D., Auger, C., & Ahmed, S. (2023). Methodologies for Evaluating the Usability of Rehabilitation Technologies Aimed at Supporting Shared Decision-Making: Scoping Review. Jmir Rehabilitation and Assistive Technologies, 10, e41359. https://doi.org/10.2196/41359 DOI: https://doi.org/10.2196/41359
Badgeley, M. A., Shameer, K., Glicksberg, B. S., Tomlinson, M., Levin, M. A., McCormick, P. J., Kasarskis, A., Reich, D. L., & Dudley, J. T. (2016). EHDViz: Clinical Dashboard Development Using Open-Source Technologies. BMJ Open, 6(3), e010579. https://doi.org/10.1136/bmjopen-2015-010579 DOI: https://doi.org/10.1136/bmjopen-2015-010579
Breitenstein, S. M., Berteletti, J., Smoske, S., Barger, C., Tipps, K., & Helsabeck, N. (2024). Administrative Dashboard for Monitoring Use of a Web-Based Parent Training Intervention: Usability Study. Jmir Formative Research, 8, e53439. https://doi.org/10.2196/53439 DOI: https://doi.org/10.2196/53439
Chaniaud, N., Métayer, N., Mégalakaki, O., & Loup‐Escande, É. (2020). Effect of Prior Health Knowledge on the Usability of Two Home Medical Devices: Usability Study (Preprint). https://doi.org/10.2196/preprints.17983 DOI: https://doi.org/10.2196/preprints.17983
Cláudio Henrique dos Santos Grecco, Isaac José Antônio Luquetti dos Santos, Farias, M. S., Farias, L. P., & Filho, A. M. V. (2021). A Fuzzy Method for the Usability Evaluation of Nuclear Medical Equipment. Brazilian Journal of Radiation Sciences, 9(2A). https://doi.org/10.15392/bjrs.v9i2a.363 DOI: https://doi.org/10.15392/bjrs.v9i2A.363
Farzandipour, M., Riazi, H., & Jabali, M. S. (2018). Proposing Electronic Health Record Usability Requirements Based on Enriched ISO 9241 Metric Usability Model. Acta Informatica Medica, 26(1), 29. https://doi.org/10.5455/aim.2018.26.29-34 DOI: https://doi.org/10.5455/aim.2018.26.29-34
Fazzino, T. L., Martin, C. K., & Forbush, K. T. (2018). Photography-Based Mobile Assessment of Alcohol Use in Young Adults: Feasibility and Comparison to Standard Assessment Methodology (Preprint). https://doi.org/10.2196/preprints.10460 DOI: https://doi.org/10.2196/preprints.10460
Hach, S., Alder, G., Stavric, V., Taylor, D., & Signal, N. (2024). Usability Assessment Methods for Mobile Apps for Physical Rehabilitation: Umbrella Review. Jmir Mhealth and Uhealth, 12, e49449. https://doi.org/10.2196/49449 DOI: https://doi.org/10.2196/49449
Hammad, K., Casey, S., Taito, R., Demas, S., Joshi, M., Rita, R., & Maisema, A. (2023). Implementation and Use of a National Electronic Dashboard to Guide COVID-19 Clinical Management in Fiji. Western Pacific Surveillance and Response, 14(5), 16–22. https://doi.org/10.5365/wpsar.2023.14.5.967 DOI: https://doi.org/10.5365/wpsar.2023.14.5.967
Harte, R., Glynn, L., Rodríguez‐Molinero, A., Baker, P., Scharf, T., Quinlan, L. R., & ÓLaighin, G. (2017). A Human-Centered Design Methodology to Enhance the Usability, Human Factors, and User Experience of Connected Health Systems: A Three-Phase Methodology. Jmir Human Factors, 4(1), e8. https://doi.org/10.2196/humanfactors.5443 DOI: https://doi.org/10.2196/humanfactors.5443
Higham, H., Greig, P., Crabtree, N., Hadjipavlou, G., Young, D., & Vincent, C. (2022). A Study of Validity and Usability Evidence for Non-Technical Skills Assessment Tools in Simulated Adult Resuscitation Scenarios. https://doi.org/10.21203/rs.3.rs-2021534/v1 DOI: https://doi.org/10.21203/rs.3.rs-2021534/v1
Karami, M., & Safdari, R. (2016). From Information Management to Information Visualization. Applied Clinical Informatics, 07(02), 308–329. https://doi.org/10.4338/aci-2015-08-ra-0104 DOI: https://doi.org/10.4338/ACI-2015-08-RA-0104
Katapally, T. R., & Ibrahim, S. T. (2023). Digital Health Dashboards for Decision-Making to Enable Rapid Responses During Public Health Crises: Replicable and Scalable Methodology. Jmir Research Protocols, 12, e46810. https://doi.org/10.2196/46810 DOI: https://doi.org/10.2196/46810
Kharazmi, E., Shirazi, A., & Yazdani, A. (2023). Development and Usability Evaluation of a Web-Based Health Information Technology Dashboard of Quality and Economic Indicators. Frontiers in Health Informatics, 12, 151. https://doi.org/10.30699/fhi.v12i0.466 DOI: https://doi.org/10.30699/fhi.v12i0.466
Lewis, J. R. (2019). Measuring User Experience With 3, 5, 7, or 11 Points. Human Factors the Journal of the Human Factors and Ergonomics Society, 63(6), 999–1011. https://doi.org/10.1177/0018720819881312 DOI: https://doi.org/10.1177/0018720819881312
Ma, Q., & Millet, B. (2021). Design Guidelines for Immersive Dashboards. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 65(1), 1524–1528. https://doi.org/10.1177/1071181321651177 DOI: https://doi.org/10.1177/1071181321651177
Moghaddasi, H., Rabiei, R., Asadi, F., & Ostvan, N. (2017). Evaluation of Nursing Information Systems: Application of Usability Aspects in the Development of Systems. Healthcare Informatics Research, 23(2), 101. https://doi.org/10.4258/hir.2017.23.2.101 DOI: https://doi.org/10.4258/hir.2017.23.2.101
Mol, M., Schaik, A. v., Dozeman, E., Ruwaard, J., Vis, C., Ebert, D. D., Etzelmueller, A., Mathiasen, K., Moles, B., Mora, T. M., Pedersen, C., Skjøth, M. M., Pensado, L. P., Piera-Jiménez, J., Gökçay, D., İnce, B. Ü., Russi, A., Sacco, Y., Zanalda, E., … Smit, J. H. (2020). Dimensionality of the System Usability Scale Among Professionals Using Internet-Based Interventions for Depression: A Confirmatory Factor Analysis. BMC Psychiatry, 20(1). https://doi.org/10.1186/s12888-020-02627-8 DOI: https://doi.org/10.1186/s12888-020-02627-8
Munbodh, R., Roth, T., Leonard, K. L., Court, R., Shukla, U., Andrea, S. B., Gray, M., Leichtman, G., & Klein, E. (2022). Real‐time Analysis and Display of Quantitative Measures to Track and Improve Clinical Workflow. Journal of Applied Clinical Medical Physics, 23(9). https://doi.org/10.1002/acm2.13610 DOI: https://doi.org/10.1002/acm2.13610
Muro-Culebras, A., Escriche-Escuder, A., Martín‐Martín, J., Roldán‐Jiménez, C., De-Torres, I., Ruiz‐Muñoz, M., González‐Sánchez, M., Mayoral, F., Biró, A., Tang, W., Nikolova, B., Salvatore, A., & Cuesta‐Vargas, A. (2021). Tools for Evaluating the Content, Efficacy, and Usability of Mobile Health Apps According to the Consensus-Based Standards for the Selection of Health Measurement Instruments: Systematic Review. Jmir Mhealth and Uhealth, 9(12), e15433. https://doi.org/10.2196/15433 DOI: https://doi.org/10.2196/15433
Parmanto, B., Lewis, A. N., Graham, K. M., & Bertolet, M. (2016). Development of the Telehealth Usability Questionnaire (TUQ). International Journal of Telerehabilitation, 8(1), 3–10. https://doi.org/10.5195/ijt.2016.6196 DOI: https://doi.org/10.5195/ijt.2016.6196
Parreira, P., Sousa, L. B., Marques, I. A., Santos‐Costa, P., Cortez, S., Carneiro, F., Cruz, A., & Salgueiro‐Oliveira, A. (2020). Usability Assessment of an Innovative Device in Infusion Therapy: A Mix-Method Approach Study. International Journal of Environmental Research and Public Health, 17(22), 8335. https://doi.org/10.3390/ijerph17228335 DOI: https://doi.org/10.3390/ijerph17228335
Rachansa, K. H., & Meditya, W. (2024). Integrated Multi-Income Stream Performance Dashboard: A Japanese Corporate Banking Case. International Journal of Advances in Data and Information Systems, 5(1), 12–28. https://doi.org/10.59395/ijadis.v5i1.1313 DOI: https://doi.org/10.59395/ijadis.v5i1.1313
Rahayu, M. E., Fitriana, G. F., & Wardhana, A. C. (2021). Prototype Aplikasi Informasi Oleh-Oleh Di Purwokerto Dengan Menerapkan Metode User Experience Lifecycle. Jurnal Ilmiah Informatika Global, 12(2). https://doi.org/10.36982/jiig.v12i2.1942 DOI: https://doi.org/10.36982/jiig.v12i2.1942
Safranek, C. W., Feitzinger, L. E., Joyner, A. K. C., Woo, N., Smith, V. K., Souza, E. D., Vasilakis, C., Anderson, T. A., Fehr, J. J., Shin, A. Y., Scheinker, D., Wang, E., & Xie, J. (2022). Visualizing Opioid-Use Variation in a Pediatric Perioperative Dashboard. Applied Clinical Informatics, 13(02), 370–379. https://doi.org/10.1055/s-0042-1744387 DOI: https://doi.org/10.1055/s-0042-1744387
Tsai, Y., Huang, J., Pu, S.-W., Chen, H.-P., Hsu, S.-C., Chang, J.-Y., & Pei, Y. (2019). Usability Assessment of a Cable-Driven Exoskeletal Robot for Hand Rehabilitation. Frontiers in Neurorobotics, 13. https://doi.org/10.3389/fnbot.2019. DOI: https://doi.org/10.3389/fnbot.2019.00003
