Modified Usability Test Scenario: User Story Approach to Evaluate Data Visualization Dashboard

https://doi.org/10.22146/ijitee.61201

Nurul Tiara Kadir(1*), Rudy Hartanto(2), Selo Sulistyo(3)

(1) Universitas Gadjah Mada
(2) Universitas Gadjah Mada
(3) Universitas Gadjah Mada
(*) Corresponding Author

Abstract


The data processing results are commonly displayed in a dashboard with various graphic visualization forms to deliver new knowledge easier to understand by users. However, many data analysis dashboards cannot communicate the knowledge effectively and efficiently given the unsuitable design implementation. Therefore, research to measure the interface display's effectiveness in the data analysis system is deemed necessary. This research proposed a scenario modification in the usability test with a user story approach to measuring the system interface display in delivering the information to users. The approach of a usability test with the user story is expected to be capable of helping the researcher in understanding the user habits indirectly. There were 20 participants to validate the proposed method. Participants were asked to use the system and answer several questions to develop their user experience. After developing user experience for each user, the System Usability Scale (SUS) was conducted. SUS score results obtained from this research was 75.25. Besides, the researcher also measured the understanding level among the users using questionnaires. The questionnaire results were converted into numbers and resulted in a mean value of 91.8. Those two values indicate the users' ability to use the system well and obtain the new knowledge displayed in the data analysis dashboard.

Keywords


Usability Test;Dashboard Interface;Data Visualization;User Story

Full Text:

PDF


References

S.K. Sahu, M.M. Jacintha, and A.P. Singh, “Comparative Study of Tools for Big Data Analytics: An Analytical Study,” 2017 Int. Conf. on Comp., Comm. and Autom. (ICCCA), 2017, pp. 37–41.

J. Nielsen, Usability Engineering, San Fransisco, USA: Morgan Kaufmann, 1993.

Y. Qi, G. Shi, X. Yu, and Y. Li, “Visualization in Media Big Data Analysis,” Proc. 2015 IEEE/ACIS 14th Int. Conf. Comput. Inf. Sci. (ICIS 2015), 2015, pp. 571–574.

“Systems and Software Engineering — Systems and Software Quality Requirements and Evaluation (SQuaRE) — System and Software Quality Models,” British Standards Institution, 2013.

J. Nielsen, “Usability Assessment Methods beyond Testing,” in Usability Engineering, San Fransisco, USA: Morgan Kaufmann, 1993, pp. 207-226.

F. Dias and A.C.R. Paiva, “Pattern-Based Usability Testing,” 2017 IEEE Int. Conf. on Software Testing, Verification and Validation Workshops (ICSTW), 2017, pp. 366-371.

R.M.L.M. Moreira and A.C.R. Paiva, “A GUI Modeling DSL for Pattern-Based GUI Testing PARADIGM,” 2014 9th Int. Conf. on Eval. of Novel Appr. to Software Eng. (ENASE), 2014, pp. 1-10.

A. Lodhi, “Usability Heuristics as an Assessment Parameter: For Performing Usability Testing,” 2010 2nd Int. Conf. on Software Technol. and Eng., 2010, pp. 256–259.

N. Binti N. Rozali and M.Y. Binti Said, “Usability Testing on Government Agencies Web Portal: A Study on Ministry of Education Malaysia (MOE) Web Portal,” 2015 9th Malaysian Software Eng. Conf. (MySEC), 2015, pp. 37–42.

J. Sauro (2011) “How to Find the Right Sample Size for a Usability Test,” [Online], https://measuringu.com/sample-size-problems/, access date: 24-Sep-2020.

J. Nasaputra (2020) “Usability Test #2: Merencanakan UT dalam 3 Tahap,” [Online], https://medium.com/belajar-desain/usability-test-2-merencanakan-ut-dalam-3-tahap-d419c2cffd6b, access date: 25-Sep-2020.

H. Loranger (2016) “Checklist for Planning Usability Studies,” [Online], https://www.nngroup.com/articles/usability-test-checklist/, access date: 25-Sep-2020.

M. Cohn, User Stories Applied: For Agile Software Development, 1st ed. Boston, USA: Addison-Wesley Professional, 2004.

D. Leffingwell, Agile Software Requirements: Lean Requirements Practices for Teams, Programs, and the Enterprise, Boston, USA: Addison-Wesley Professional, 2010.

P. Abrahamsson, O. Salo, J. Ronkainen, and J. Warsta, Agile Software Development Methods: Review and Analysis, Vuorimiehentie, Finland: Julkaisija – Utgivare – Publisher, 2002.

J. Brooke, “SUS: A Retrospective,” J. Usability Studies, Vol. 8, No. 2, pp. 29-40, Feb. 2013.

J. Sauro, “5 Ways to Interpret a SUS Score,” [Online], https://measuringu.com/interpret-sus-score/, access date: 9-Aug-2020.



DOI: https://doi.org/10.22146/ijitee.61201

Article Metrics

Abstract views : 1732 | views : 889

Refbacks

  • There are currently no refbacks.




Copyright (c) 2021 IJITEE (International Journal of Information Technology and Electrical Engineering)

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

ISSN  : 2550-0554 (online)

Contact :

Department of Electrical engineering and Information Technology, Faculty of Engineering
Universitas Gadjah Mada

Jl. Grafika No 2 Kampus UGM Yogyakarta

+62 (274) 552305

Email : ijitee.ft@ugm.ac.id

----------------------------------------------------------------------------