Welcome!
To use the personalized features of this site, please log in or register.
If you have forgotten your username or password, we can help.
My Menu
Saved Items

“How Do I Evaluate THAT?” Experiences from a Systems-Level Evaluation Effort

Pardha S. Pyla17 Contact Information, H. Rex Hartson17 Contact Information, Manuel A. Pérez-Quiñones17 Contact Information, James D. Arthur17 Contact Information, Tonya L. Smith-Jackson17 Contact Information and Deborah Hix17 Contact Information

(17)  Center for Human-Computer Interaction, Virginia Tech, Blacksburg, VA 24060, USA
Abstract
In this paper we describe our experience deriving evaluation metrics for a systems-level framework called Ripple that connects software engineering and usability engineering life cycles. This evaluation was conducted with eight teams of graduate students (falling under four types of development models) competing in a joint software engineering and usability engineering course to create a software solution for a real world client. We describe the challenges of evaluating systems-level frameworks and the approach we used to derive metrics given our evaluation context. We conclude with the outcome of this evaluation and the effectiveness of the metrics we employed.

Keywords  Systems-level evaluation - evaluation metrics - goal-question metric


Contact Information Pardha S. Pyla
Email: ppyla@vt.edu

Contact Information H. Rex Hartson
Email: hartson@vt.edu

Contact Information Manuel A. Pérez-Quiñones
Email: perez@vt.edu

Contact Information James D. Arthur
Email: arthur@vt.edu

Contact Information Tonya L. Smith-Jackson
Email: smithjack@vt.edu

Contact Information Deborah Hix
Email: hix@vt.edu
Fulltext Preview (Small, Large)
Image of the first page of the fulltext

References secured to subscribers.



Export this chapter
Export this chapter as RIS | Text
 
Remote Address: 38.107.191.111 • Server: MPWEB25
HTTP User Agent: CCBot/1.0 (+http://www.commoncrawl.org/bot.html)