Using GOMS and NASA-TLX to Evaluate Human–Computer Interaction Process in Interactive Segmentation
International Journal of Human-Computer Interaction , Volume 33 - Issue 2 p. 123- 134
HCI plays an important role in interactive medical image segmentation. The Goals, Operators, Methods, and Selection rules (GOMS) model and the National Aeronautics and Space Administration Task Load Index (NASA-TLX) questionnaire are different methods that are often used to evaluate the HCI process. In this article, we aim at improving the HCI process of interactive segmentation using both the GOMS model and the NASA-TLX questionnaire to: 1) identify the relations between these two methods and 2) propose HCI design suggestions based on the synthesis of the evaluation results using both methods. For this, we conducted an experiment where three physicians used two interactive segmentation approaches to segment different types of organs at risk for radiotherapy planning. Using the GOMS model, we identified 16 operators and 10 methods. Further analysis discovered strong relations between the use of GOMS operators and the results of the NASA-TLX questionnaire. Finally, HCI design issues were identified, and suggestions were proposed based on the evaluation results and the identified relations.
|International Journal of Human-Computer Interaction|
|This work was funded by the European Commission 7th Framework Programme; grant id fp7/290148 - Software for the Use of Multi-Modality images in External Radiotherapy (SUMMER)|
|Organisation||Biomedical Imaging Group Rotterdam|
Ramkumar, A, Stappers, P.J, Niessen, W.J, Adebahr, S, Schimek-Jasch, T, Nestle, U, & Song, Y. (2017). Using GOMS and NASA-TLX to Evaluate Human–Computer Interaction Process in Interactive Segmentation. International Journal of Human-Computer Interaction, 33(2), 123–134. doi:10.1080/10447318.2016.1220729