pdf
The Lure of the Measurable in Design Research

CLAUDIA ECKERT

Engineering Design Centre, Department of Engineering, University of Cambridge

MARTIN STACEY

School of Computing, De Montfort University, Leicester, UK.

P. JOHN CLARKSON

Engineering Design Centre, Department of Engineering, University of Cambridge

Proceedings of Design 2004, 8th International Design Conference
The Design Society, Cavtat, Dubrovnik, Croatia, May 2004, pp. 21-26.

ABSTRACT. Beginning design research projects by defining success criteria, judged by numerical measurements, is a very attractive idea. But defining a priori success criteria is problematic, as is using numerical metrics to assess the success of a new method or computer tool. The paper points out some pitfalls of using metrics for success. It argues from experience of studying design processes that projects should begin with objectives derived from research questions, but these objectives should be revised as needs and opportunities emerge. Success criteria for of new methods and tools should be derived later from a detailed specification of requirements. Researchers should aim first for understanding their effects, and derive evaluations from that.

KEYWORDS. Design research methodology, design processes, computer tools for design.

Author addresses.

Claudia Eckert
The Design Group
Department of Design, Development,
    Environment and Materials
Faculty of Mathematics, Computing and Technology
The Open University
Milton Keynes MK7 6AA
United Kingdom
C.M.Eckert@open.ac.uk

Martin Stacey
Department of Computer Technology
Faculty of Technology
De Montfort University
Leicester LE1 9BH
United Kingdom
mstacey@dmu.ac.uk

John Clarkson
Engineering Design Centre
Department of Engineering
University of Cambridge
Trumpington Street
Cambridge CB2 1PZ
United Kingdom
pjc10@eng.cam.ac.uk