David Gilmore & So Young Kim, GE Global Research Center and Tina Lee, GE Power
Over the past 3 years or more we have been redesigning the user experience of GE’s gas turbine HMI for combined cycle power plants and numerous evaluations (both formative and summative) have taken place along the way as part of the design process. However, now we are at the point where the new HMI is going live in real power plants and we are evaluating the complete user experience. In this paper we will present a case study of the design process and our experiences to date in evaluating the ‘finished’ system, revealing how design-oriented evaluations, although critical to design, are no substitute for real-world evaluations of the whole system, and yet we find few methods for taking a wholistic, system-minded view of the evaluation of user experience. We now understand that our perspective on user experience is very similar to a complex systems view – and methods that are good for evaluating features do not readily adapt to the wholistic system view.