User Evaluation of HCI Concepts for Defining Product Form
-
Upload
john-smith -
Category
Documents
-
view
222 -
download
0
Transcript of User Evaluation of HCI Concepts for Defining Product Form
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
1/18
User evaluation of HCI conceptsfor defining product form
Bahar Sener, Department of Industrial Design, Faculty of Architecture,
Middle East Technical University, Ino nu Bulvari, Ankara 06531, Turkey
Paul Wormald, Department of Design and Technology, LoughboroughUniversity, LE11 3TU, United Kingdom
A complaint amongst industrial designers is that the humanecomputer
interaction (HCI) of computer-aided design (CAD) systems does not fit their
needs for defining product form. This paper disseminates research to identify
and address the shortfalls. A strengths and weaknesses analysis of three
modelling media (foam, CAD, FreeForm) is reported and used to influence the
design of 11 novel HCI concepts for form creation. Expert users are found to
prefer virtual workshop and intelligent environment concepts, whilst
immersive environments capable of rapid project switching are liked. The results
justify initiatives for developing prototype and commercial systems.
2007 Elsevier Ltd. All rights reserved.
Keywords: computer-aided design, design tools, humanecomputer interaction,
industrial design, product modelling
Three-dimensional computer-aided design (3D CAD) is a ubiquitous
and indispensable tool for industrial design, being the primary means
for modelling and communicating product design proposals. How-
ever, a recurring complaint from industrial designers is that 3D CAD is too
rooted in engineering design, and is directed towards neither their own creative
practices for defining the form of a product (i.e. the activity of form creation)
nor their underlying need for sketching (Hummels, 2000; Shillito et al., 2003).
The general concern in the literature is that the creatively intense early phase of
industrial design, where the form of a product is in a conceptual and fluid
state, is very poorly supported. Until improved digital tools are realised, indus-
trial designers are resigned to adapt to 3D CAD essentially built for other pro-
fessions (Hanna and Barber, 2001; Sener et al., 2002).
This present research had the aim of closing the gaps between current 3D CAD
packages and envisioned systems specifically devised for industrial design
practice. It addressed the research question: in what ways can digital design
tools be enhanced or superseded to fit better to industrial designers needs
for conceptual form creation? Of concern was a need to examine in documen-
tary detail what industrial designers liked and disliked about form creation in
Corresponding author:
Bahar Sener
www.elsevier.com/locate/destud
0142-694X $ - see front matter Design Studies 29 (2008) 12e29
doi:10.1016/j.destud.2007.06.003 12 2007 Elsevier Ltd. All rights reserved. Printed in Great Britain
mailto:[email protected]://-/?-http://-/?-mailto:[email protected] -
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
2/18
a variety of modelling media, and then to illuminate ways in which computers
can e and could e provide improved support.
Presently only two systems are marketed as supporting conceptual form crea-
tion for industrial design: AliasStudio (Autodesk, 2007) and FreeForm Vir-
tual Clay Haptic Modeling System (SensAble Technologies Inc., 2007). The
former makes good use of imported sketch elevation drawings and can be con-
nected to a tablet PC to allow direct freehand drawing. The latter utilises hap-
tic technology (force and kinaesthetic feedback) to harness designers sense of
touch, which is prominent during sketch modelling with workshop media such
as foam and clay. Such manual modelling activity draws upon what is termed
enaction: the demonstration and acquisition of knowledge through the act of
performing skilled physical pursuits, especially those requiring dexterity and
subtle exercising of, and reactions to, tacit motor responses ( European Enac-
tive Network of Excellence, 2007).
Accordingly, enactive computer interfaces have been identified as a potentiallydesirable, immediate and intuitive means of HCI for industrial designers
(Sener, 2007; Bordegoni and Cugini, 2006). However, their implementation
within 3D CAD is at an early stage, largely as a result of technical limitations
and a legacy in which HCI for 3D CAD commenced from a conceptually
opposite direction of text-based instructions (Verplank, 2003). Indeed,
FreeForm still relies on considerable CAD-like command interaction (i.e.
menus, keyboard input, mouse actions) to accompany its haptic capabilities.
Conceptual design receives scant attention in HCI literature, with the balance
of research firmly on technical developments and system-specific evaluations.
This is most surprising, since matters of detail become largely academic if un-
derlying concepts are found to be inadequate. As this paper will argue, there is
much that is still inadequate concerning digital tools for industrial design. The
position taken is that only through examination at a fundamental operational
and conceptual level can the nature of those inadequacies be revealed.
1 Research methodThe kinds of forms digital design tools will take in the future is not a subject
frequently visited in the literature. Reports of empirical research into indus-
trial designers form creation activities are also relatively sparse. Previous stud-
ies have failed to examine in detail the comparative strengths and weaknessesof the various modelling media designers use, instead concentrating in the
main on modelling technique and good practicee often for just one modelling
medium. This situation is not so surprising, since to generate empirical evi-
dence that exposes designers general form creation needs, rather than their
perceived needs or scattered anecdotal evidence, requires considerable effort.
Generation of this comparative evidence base was deemed a vital first step
for ensuring the credibility of any new HCI concepts for 3D CAD.
User evaluation of HCI concepts for defining product form 13
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
3/18
The research therefore commenced with a substantial documentary study of
industrial designers form creation activities with two established media (blue
polystyrene foam, conventional CAD) and one state-of-the-art medium
(FreeForm). This approach avoided retrospective accounts that would typi-
cally contain generalised rather than specific experiences. The study comprised
a series of 40 design and modelling experiment sessions, each lasting approxi-
mately two hours, conducted with a total of 16 UK-based participants across
two groups. Group 1 contained eight participants, spanning employed, free-
lance, university staff and postgraduate industrial designers. They worked
with all three media (24 sessions). Group 2 also contained eight participants,
but all were undergraduates. They worked with only foam and conventional
CAD (16 sessions). A variety of 3D CAD systems were used (3DStudio Max,
AutoCAD, I-DEAS, Lightwave 3D, Mechanical Desktop, Pro/Engineer, Rhinoc-
eros, SolidWorks)e these being the participants preferred and familiar systems.
Each session involved a participant creating the form for a small-sized
household item (perfume container, salt and pepper shaker) or consumerelectrical product (computer mouse, computer speakers) using just one
modelling medium. To limit any order effect, the participants worked on
different products for each modelling medium, thereby reducing the like-
lihood of transferring experiences from one session to another. In addition,
each participant completed a mood adjective checklist before and after
each session (Mackay et al., 1978). The evaluation of the checklist revealed
no experiment conditioning and no order effects between the various com-
binations of sessions and modelling media. The participants were free to
use pen and paper sketching during the sessions.
Real-time data were generated through video recording and researcher obser-
vation, and were accompanied by questionnaires completed by the partici-
pants during the sessions, which gauged the participants first-hand
experiences of modelling. A review interview was held at the end of each ses-
sion to provide an opportunity to clarify any element of the generated data,
and to allow participants an opportunity to volunteer further insights into
their modelling. As far as is known, the experiments comprised the first major
comparative study of 3D sketch modelling in industrial design.
A full account of the data collection, code-based processing and analysis
would be too lengthy for inclusion here, so readers are referred to its pri-mary documentation (Sener, 2004). Of importance and relevance for this
paper was the data originating from the questionnaires and review inter-
views. These comprised approximately 800 individual statements on the
strengths and weaknesses of the three modelling media. A hybrid strengths
e weaknesses e opportunities e threats (SWOT) analysis, based on guide-
lines by Ulrich and Eppinger (1995), was followed to translate the strength
and weakness statements into a set of customer need statements for
14 Design Studies Vol 29 No. 1 January 2008
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
4/18
improved digital industrial design tools. Briefly, this involved collating and
consolidating the collective strengths across the three modelling media and
redressing (i.e. reversing the expressed negativity) of the collective
weaknesses.
Figure 1 contains the definitive set of customer need statements. The process-
ing procedure determined a priority position for each customer need state-
ment, so that Figure 1 presents the statements in priority order from the
especially important at the head to the moderately important at the foot.
The participants used the terms quick, easy and good interchangeably.
This was taken into account during the data processing and, for the sake of
data reduction and consolidation, statements making use of any of these
words were replaced with the conjunction quick/easy/good.
Figure 1 Prioritised customer
needs for improved digital
tools for industrial design
User evaluation of HCI concepts for defining product form 15
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
5/18
Figure 1 can be regarded as an explicit guide to desirable specifications for dig-
ital industrial design tools and their associated HCI. Four key themes could be
identified.
Bulk/sketch form creation. The highest priority customer need statement e
quick/easy/good basic form creation e refers to sketching of product form
in a proportionally correct and simplified manner free of constraints and
dimensions.
Control of form creation. Seven customer need statements pointed to con-
trolled form creation: constrainable tools, constrained form creation, pre-
cise, quick/easy/good detailing, quick/easy/good attribute control, and
quick/easy/good uniform surface finish/texture.
Ease of form creation. Six customer need statements pointed to minimal ef-
fort and removing obstacles in creating form: user-friendly interfaces, useful
variety of modelling tools, high proficiency with minimal practice, form cre-
ation guidance, form construction aids, and comfortable input devices.
Life-like form creation. Five customer need statements pointed to replicat-ing the sensory experience of creating physical models: life-like model ap-
pearance, life-like tool/material contact, model interaction with hands,
haptic feedback, and tools analogous to workshop tools.
The first two of these themes are clearly in tension. Thus, the results showed
that the absence of convincing digital sketching provision, and in particular
a lack of marriage between sketch form creation and constrained form crea-
tion, in both 2D and 3D modelling environments, is a major dissatisfaction
for industrial designers in their use of present-day CAD.
2 HCI design2.1 IdeationWithin their own wording the customer need statements fall short of providing
ideas for HCI solutions (as is normal). It is only through creative input e
designing e that customer needs can be acted upon and tangible ideas pro-
posed. It was therefore essential to integrate a design project into the research
so that the customer need statements could be translated into envisaged new
3D CAD systems. This was achieved during a period of practice-led design re-
search (Pedgley and Wormald, 2007; Arts and Humanities Research Council,
2007).
The designing was undertaken by the first author, a trained industrial designer,
who drew upon a variety of specific experiences and sources of information to
assist in ideation. The major inputs were: (i) the set of 30 customer needs in
Figure 1, (ii) prior art reviews concerning the history of 3D CAD development,
and (iii) a four month industrial placement at Procter & Gamble Technical
Centres UK. During the placement, the author was employed to design,
16 Design Studies Vol 29 No. 1 January 2008
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
6/18
model, and prototype new consumer goods using the FreeForm system. As
a practising designer in Procter & Gamble, she had significant professional au-
thority for her investigations of how 3D CAD was perceived and used by other
designers. Her involvement in the day-to-day business of the companys NPD
programmes provided evidence of the uses of 3D CAD that otherwise would
have been impossible to obtain. It also allowed for an effectiveness evaluation
of 3D CAD driven by haptic interfaces, within a commercial context.
Other inspiration to aid the designing came from wider reading in the cross-
overs between communication technologies and contemporary product de-
sign, as well as personal experiences of 3D sketch modelling in a variety of
media. Specific sources included Philips Vision of the Future (Philips Design,
1996) and several Hollywood sci-fi movies including Minority Report, The
Matrix Trilogy and The World Is Not Enough.
2.2 User participationEnd users were engaged in the design project to share ideas, create synergiesand generally enrich the design activity and outcomes. Six participants were
recruited from amongst the pool of eight within group 1 of the design and
modelling experiments. All of the participants therefore possessed a heightened
awareness of the research aims and had first-hand experience of state-of-
the-art modelling through their FreeForm sessions.
The first author also assumed the role of facilitator and note taker, during the
two three-hour sessions. The first session focused on generating individual
ideas for new kinds of form creation tools and environments. It was explicitly
stated that acceptable ideas could be either incremental improvements to
existing technologies or future-gazing solutions. The set of customer need
statements was provided as a stimulus. The second session employed scenario
building (Hasdogan, 1997) to elicit ideas on how individual ideas could be
combined.
The participants communicated their proposals through A2 sketch sheets and
verbal reports. Following the sessions, the proposals were examined for com-
mon features, which were then visually or verbally grouped under keyword
headings. The proposals showed a general desire for designers to work within
more dedicated, customisable surroundings enhanced by digital technologies.
2.3 Concept developmentConcept development continued as a solo effort by the first author. Two
strands identified from the user participation sessions were adopted to aid
the process: workspace concepts (broadly referring to digitally enhanced en-
vironments for industrial designers to work in) and form creation concepts
(broadly referring to new HCI for industrial designers to digitally define prod-
uct form). The separation is acknowledged to be forced, particularly since with
User evaluation of HCI concepts for defining product form 17
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
7/18
technologies such as immersive virtual reality (VR), as far as users are con-
cerned the workspace becomes almost imperceptible and the form creation
dominates. The separation was nonetheless helpful in directing the emerging
design ideas and communicating the final concepts.
A balance was sought between concepts that were immediately realisable (andthat suggested incremental improvements to, and combinations of, existing
technologies), and those that would require technology to advance. Special at-
tention was paid towards developing concepts that offered plausible new
routes for digitally sketching product form. In all cases, the concepts were re-
quired to be coherent in the sense that they combined individual ideas into
a convincing system. It was an explicit objective to satisfy the highest number
of customer need statements as practically possible, although it will be appre-
ciated that not all customer needs could be satisfied within a single concept
without that concept becoming too incoherent. Matrices were used to check
the compliance of each concept against the 30 customer need statements.
A portfolio containing eleven individual concepts was prepared: four workspace
concepts and seven form creation concepts.A name was assigned to each concept
and a text description of the essence of the concept was written. The concepts
were prepared as presentation-quality colour illustrations in a purposefully
cartoon style. The style choice was important: it was chosen to promote flexibil-
ity in interpretation, rather than finality in specification that would inevitably
accompany a photorealistic rendering or physical mock-up.
3 Concept portfolioFigures 2 and 3 show the illustrations for the workspace and form creationconcepts.
3.1 Workspace conceptsWC1 Desktop Computing enhances the sensory information experienced by
designers within a contemporary desk environment, utilising multiple and in-
terchangeable input devices connected to large flat screen displays, including
haptic devices and optional stereovision glasses.
The idea behind WC2 Immersive Room is to set an immersive theme andmood within a dedicated collaborative workroom, in a similar way to desktop
themes and wallpaper in Microsoft Windows or Mac OS. The environment
can be instantaneously switched from project to project, with full-scale projec-
tions of, for example, CAD software, moodboards, competitor products and
products in use. The workspace is used in conjunction with wireless tablet
PCs and optional haptic gloves and stereovision glasses. The designers are
free to sit or stand.
18 Design Studies Vol 29 No. 1 January 2008
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
8/18
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
9/18
3.2 Form creation conceptsTwo-handed haptic feedback is the essential feature of FC1 Dual Co-Located
Haptic Devices, which combines elements of the FreeForm system with be-spoke hardware manufactured by Reachin Technologies AB (2007). The latter
comprises a monitor that displays a CAD model stereoscopically and in mir-
ror image so that when viewed on a reflective screen the model appears con-
vincingly in 3D and in correct orientation. Thus, the on-screen cursor
(modelling tool) controlled by the FreeForm input device (Phantom) is co-
located (hand-eye coordinated) with the physical nib position of the Phan-
tom. This concept specifically addresses the absence of two-handed control
and realistic movement within present haptic systems. One hand is intended
to grasp the model (using a haptic glove), whilst the other is intended to shape
the material (using the Phantom). The palette of modelling tools could be for
any virtual material, although foam and clay are most suited to industrial
design. Tools ranging from delicate hand tools to large machine tools would
be recreated digitally.
The intention behind FC2 Smart Material is to make form creation with dig-
ital tools as interactive and spatially free-moving as the manual shaping of
workshop materials. It relies on the use of malleable material impregnated
Figure 3 Form creation con-
cepts FC1 through to FC7
20 Design Studies Vol 29 No. 1 January 2008
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
10/18
with particles that can be continuously position-detected in 3D space, allowing
a digital equivalent of designing-and-making.
FC3 Haptic Holographic Representation uses a form of non-physical rapid
prototyping, allowing visual, haptic and walk around evaluation of an
emerging product form projected holographically from a pod. It is an entirely
waste-free and instantaneous system, independent of modelling software, and
is intended to assist in real-time form modifications and collaborative product
evaluation between remote sites. Optional stereovision glasses and haptic fin-
ger thimbles are used to allow enhanced sensory evaluation.
The premise behind FC4 Sequential Scanning is that organic and texturised
forms are easyto create in non-digitalmedia (e.g. foam, clay); the concept builds
upon this and includes intelligent reverse engineering software to automatically
create high-quality editable surface models (i.e. constructed from splines, arcs,
circles, lines etc.) from point cloud scan data of pre-modelled forms.
FC5 Squidgy Sponge is a highly interactive wireless input device that can be
manipulated and deformed in 3D, with the resulting deformations mapped
onto selected areas of a digital model in real-time. The device can be twisted,
indented, squeezed, tapered, stretched, squashed, folded etc. The device can
also be deformed by pressing a physical object into it.
FC6 Verbal/Gestural Input extends the application of gestural sketching
(Hummels, 2000), in which the movement of ones hands, arms or head be-
comes a tool for sketching, and in so doing overcomes spatial and functional
limitations of 2D (planar) movement associated with pen and paper sketching.
At its heart is personal expression, allowing designers to act out and talk
through their ideas for product form. The system uses motion trackers and
microphones to capture input data, whilst stereovision glasses may be option-
ally worn.
The familiarity of paper-based sketching is harnessed in FC7 Automated 2D-
to-3D Translation and augmented by intelligent software to create clean
model geometry and a correspondingly high-quality surface model. The soft-
ware shows in real-time how a product sketched in 2D elevations on a tablet
PC will appear as a 3D form. This concept takes influences from sketch map-
ping (Tovey, 2002) and proven methods of 2D-to-3D translation (Igarashi andHughes, 2003), and represents an attempt to harness and surpass functional
and qualitative aspects of paper-based sketching. It is intended to relieve
designers of the relatively mundane task of 3D CAD geometry construction.
4 Evaluation methodThe evaluation of the concepts was carried out through a questionnaire dis-
tributed to ten participants: the same eight participants of group 1 in the
User evaluation of HCI concepts for defining product form 21
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
11/18
design and modelling experiments, and two additional staff industrial de-
signers at Loughborough University. A 100% return rate was achieved. The
participants were chosen because collectively they represented an elite group
of especially well informed designers, having had significant prior involvement
in the research. They had also demonstrated proficiency in foam and CAD and
had practical experience with FreeForm. The continued involvement of the
same participants was viewed positively and was expected to lead to particu-
larly critical evaluation of the concepts.
A questionnaire was chosen over individual interviews to allow the partici-
pants to pace themselves during their evaluations and to create a standardised
set of data (Jorgensen, 1989). The overall aim was to identify the most fav-
oured and least favoured concepts, and to identify the features and characters
of those concepts that led to their particularly supportive or unsupportive
evaluation. Each concept was requested to be evaluated individually against
three principal criteria: enjoyment, inspiration and assistance. When combined,
these three criteria were intended to create a good assessment of the overall de-
sirability of the concepts as measured by long-term use (enjoyment), stimula-
tion for design ideas (inspiration) and utilitarian benefits (assistance). Figure 4
shows the questionnaire template and the use of Likert scale statements to
elicit participants reactions.
The Likert scale deliberately lacked a neutral response to encourage the par-
ticipants to express an opinion. The fourth statement, concerning preferential
use, was added to directly assess participants acceptance of change and overall
impressions. This preference data would allow a ve/ve correlation to beestablished against researcher-constructed overall data (comprising a summa-
tion of enjoyment, inspiration and assistance data) and would therefore act as
a methodological test. A short summary of the participants reasons for agree-
ing or disagreeing with the questionnaire statements was also requested.
Figure 4 Questionnaire
template
22 Design Studies Vol 29 No. 1 January 2008
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
12/18
A briefing session was held prior to delivery of the questionnaire, to remind the
participants of the purposes of the work and the specific aims of the concept
evaluation. Written instructions on how to complete the questionnaire were
provided. The concepts were presented within a ring-bound portfolio, contain-
ing the concept illustrations and text descriptions. A time limit of two hours
was set to view the portfolio and complete the questionnaire.
4.1 Data analysis procedureThe data were analysed by assigning numerical scores to each of the Likert
scale grades, so that a quantitative measure of success for each concept could
be calculated (Brace, 2004). The data were scored as follows: strongly agree
(2), tend to agree (1), tend to disagree (1) and strongly disagree (2).
The score range per criterion was 20 (2 maximum/minimum score, ten par-
ticipants). The overall score range per concept was 60 (20 per criterion,
three criteria). To aid comparisons and discussion, all data were converted
to percentage of score range, creating the following categories.
x ! 50% participants strongly agreed
50%> x> 0% participants tended to agree
50%> x> 0% participants tended to disagree
x ! 50% participants strongly disagreed
The participants comments regarding their agreement or disagreement with
the questionnaire statements were logged verbatim. Keywords were then ex-
tracted from the comments in order to develop a deeper understanding of
the successes and failures of each concept.
5 ResultsFigures 6, 7 and 8 show the results of the individual evaluations for enjoyment,
inspiration and assistance, respectively. Figure 5 presents the results of the
Figure 5 Results e overall
evaluation
User evaluation of HCI concepts for defining product form 23
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
13/18
overall evaluation, as a summation of the individual evaluations, whilst
Figure 9 presents the results of the preference evaluation.
The first general observation to note is that the concepts scored very highly for
enjoyment (mean 61%) and assistance (mean 48%), and reasonably
well for inspiration (mean 32%). Negativity towards any of the conceptswas extremely isolated, occurring in only two out of a possible 55 evaluations
(11 concepts, five individual evaluations): WC1 (20% for inspiration) and
FC6 (5% for preference).
5.1 Enjoyment evaluationParticipants strongly agreedthat all the concepts would be enjoyable to use,
except FC4 (40%) and FC6 (45%), which they only tended to agree would
be enjoyable to use. The participants comments revealed their relative lack of
enthusiasm towards FC4 was because the concept was seen as too procedural
and slower than alternative methods of digital form creation. For FC6, the
participants raised concerns over modelling accuracy, difficulties in describing
complex forms and intricate details, usability, and anxiety about talking aloud
and making gestures.
5.2 Inspiration evaluationIn general, the participants tended to agree that the presented concepts would
be inspirational to their design practice. However, WC2 (75%) and WC4
(70%) were found to be strongly inspirational whereas participants tended
to disagree that WC1 (20%) was inspirational. Many aspects of WC2 were
praised by the participants: the immersive approach, project interchangeabil-
ity, concentration and variety of information, high levels of communication,
opportunities for teamwork and the ability to visualise ideas full-scale. Simi-
larly high praise was given to WC4, with participants keen on its advanced in-
teractive visualisation, its versatility, the ability to visualise ideas full-scale, the
general scope of sensory information that it affords, and its facility for up-
stream virtual product testing. The participants negativity towards WC1
was shown in comments referring to the normality of a modern-day office,
poor interaction between people, few external stimuli and a confined
workspace.
5.3 Assistance evaluationIn general, participants strongly agreedthat the concepts would be assistive totheir design practice. However, three concepts fell within the tended to agree
category: WC1 (35%), FC5 (35%) and FC6 (5%). The relative lack of
enthusiasm for WC1 and FC6 was accounted for in Sections 5.1 and 5.2. Com-
ments on FC5 showed the participants to be concerned about accuracy, con-
trol, realisation of form details, difficulties in achieving organic forms, and its
limitation as a purely deformation-making tool.
24 Design Studies Vol 29 No. 1 January 2008
http://-/?-http://-/?- -
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
14/18
5.4 Overall evaluationFive concepts received overall scores !50%: WC2 (62%), WC4 (67%),FC2 (60%), FC3 (57%), and FC7 (50%). These five concepts represent
the participants most favoured potential uses of digital technologies for prod-
uct form creation. The scores for the remaining six concepts ranged from
23% to 47%, indicating that participants possessed overall support for
all 11 concepts in the portfolio, with none of the concepts having overall
rejection.
5.5 Preference evaluationParticipants direct preference data (Figure 9) provided opportunity for com-
parison and corroboration with the researcher-derived summed overall score
combining enjoyment, inspiration and assistance (Figure 5). The resultsshowed that the rank order of the participants direct preference scores corre-
lated well with that of the researcher-derived overall scores, although some dif-
ferences existed in the score values (which will be examined shortly). On the
whole, the combination of enjoyment, inspiration and assistance criteria suc-
cessfully indicated designers willingness to change from current digital mod-
elling systems to new ones. Their adoption as evaluation criteria was therefore
methodologically vindicated.
The participants tended to agree that the concepts were preferable to their pres-ent systems (mean 31%). Exceptions to this were: FC3, which was consid-
ered strongly preferable (60%), and FC6, which was not considered
preferable (5%). The participants expressed a strong preference for FC3 be-
cause of its strong full-scale visualisation capabilities, the ability to walk
around a projected product and view it from unlimited viewpoints, its 3D sen-
sory feedback, and the attractiveness of appending it to existing CAD systems.
The negativity towards FC6 echoed the comments reported in Section 5.1.
Figure 6 Results e enjoyment
evaluation
User evaluation of HCI concepts for defining product form 25
http://-/?-http://-/?- -
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
15/18
With regard to the workspace concepts, WC1 was rated the least popular un-
der both evaluations and received consistent scores (27% overall, 25%
preference). WC3 was ranked differently under the evaluations (third for over-
all, first for preference), although it received a consistent score of 47% and
45%, respectively. Some inconsistencies were shown for WC2 and WC4. Al-
though both of these concepts received similar rankings under both evalua-
tions (WC2 either second or third; WC4 either first or second), the scores
under the two evaluations differed (WC2 62% overall, 30% preference;
WC4 67% overall, 35% preference). The participants were therefore con-
siderably less enthusiastic about adopting WC2 or WC4 in preference to their
current systems. This may be because WC2 and WC4 are technologically quite
advanced from current systems and invoke some scepticism over their likely
success of implementation, despite acknowledged conceptual benefits.
Cross-comparisons were also made for the form creation concepts. FC1, FC4,
FC5 and FC6 were ranked as the lowest four concepts under both evaluations,
with FC1 consistently fourth least popular and FC6 consistently the most least
popular. The rank order of FC4 and FC5 swapped between the two evalua-
tions. A comparison of the scores received for these four concepts revealed
that the preference evaluation was consistently less favourable than the overall
evaluation, indicating that despite acknowledging individual benefits within
these lowest ranked concepts, the participants were not convinced that overall
they would be preferable to their current systems.
In contrast, FC2, FC3 and FC7 were the three highest ranked concepts under
both evaluations. FC7 was consistently ranked third, whilst the rank order of
FC2 and FC3 swapped between the two evaluations. The scores between the
two evaluations of FC2, FC3 and FC7 were reasonably close (FC2 60%
overall, 45% preference; FC3 57% overall, 60% preference; FC7 50%
overall, 45% preference), showing that the participants considered these
Figure 7 Results e inspiration
evaluation
26 Design Studies Vol 29 No. 1 January 2008
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
16/18
concepts to be strong, whether assessed as a whole or analysed against individ-
ual criteria.
6 Discussion and conclusionsA case has been made for industrial designers to be served with 3D CAD sys-
tems that fit better to their specialist activities of defining product form. The
thrust of the argument is that a conceptual shift must take place if industrial
design practice is to be better supported by digital technologies. The combina-
tion of sketch andconstrained form creation was found to be especially desir-
able, but remains elusive in currently available systems. Any replacement
system should be based on surface modelling technology (e.g. NURBS: non-
uniform rational b-spline surfaces), rather than polygon mesh models, to max-
imise usefulness in downstream manufacturing and analysis applications.
Eleven concepts were generated and subjected to a first-stage evaluation by ex-
pert users, who assessed their suitability as HCI solutions for defining product
form. The users were found to favour HCI providing naturalistic, spontaneous
and expressive tools for sketch form creation, specifically away from the
paradigm of conventional desktop CAD. For workspaces, users showed
most enthusiasm towards dedicated and customisable workrooms, where an
immersive environment can be set and switched seamlessly from project to pro-
ject. For form creation tools, users showed most enthusiasm towards what may
be termed virtual workshops (digital emulations of existent skills in modelling
with physical materials) and intelligent environments (supplementing cogni-
tive modelling skillsemental imaginge through assistive digital visualisation).
Five concepts were evaluated as especially desirable to users: WC2 Immersive
Room, WC4 Advanced Wireless Virtual Reality, FC2 Smart Material, FC3
Haptic Holographic Representation and FC7 Automated 2D-to-3D
Translation.
Figure 8 Results e assistance
evaluation
User evaluation of HCI concepts for defining product form 27
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
17/18
For virtual workshops, it is acknowledged that the quality of haptic feedback
offered by enactive HCI will need to dramatically improve if digital modelling
experiences are to become convincing reproductions of designing-and-making
in the physical world. The most valued technological advances will be those
that make it possible to grasp models, to have two-handed control of model-
ling tools, and that provide a facility to rub ones fingertips and palms across
model surfaces to evaluate and adjust for ergonomics, aesthetics and other
matters of fitness of form. Haptic devices that are less invasive (e.g. smaller,
less heavy) and that have multipoint sensors (e.g. on fingers, thumbs and
palms) will be necessary to create more authentic modelling experiences.
The realisation of intelligent environments will hinge on the development of
smart software to help designers in two respects: (i) releasing them from the
command-led constrained nature of conventional 3D CAD; and (ii) makinggood use of their existent design and communication skills, including freehand
elevation sketching.
The next stage for this research is to cooperate with experts in human and
computer sciences to develop the strongest concepts to a prototype stage, so
that a second-stage evaluation may be performed with a larger and more
general group of industrial designers. It will be important to use multimedia
techniques and mock-ups to communicate the essence of the concepts in a man-
ner that is more advanced than 2D illustrations and text descriptions. The
findings of the second-stage evaluation will be useable in directly driving the
development of new commercial systems.
AcknowledgementsThe authors are most grateful to Dr Owain Pedgley for his input into the drafts
of this paper and to all the research participants who took their valuable time
to have a say over the possible futures for digital industrial design tools.
Figure 9 Results e preference
evaluation
28 Design Studies Vol 29 No. 1 January 2008
-
8/3/2019 User Evaluation of HCI Concepts for Defining Product Form
18/18
ReferencesArts and Humanities Research Council (2007) Research review: practice led
research in art, design and architecture available at: http://aces.shu.ac.uk/ahrc
(accessed 6 June 2007)
Autodesk (2007) available at: http://www.autodesk.com (accessed 6 June 2007)
Bordegoni, M and Cugini, U (2006) Haptic modeling in the conceptual phases of
product design Virtual Reality Vol 9 No 2 pp 192e
202Brace, I (2004) Questionnaire design Kogan Page Ltd, London
European Enactive Network of Excellence (2007) available at: http://www.
enactivenetwork.org (accessed 6 June 2007)
Hanna, R and Barber, T (2001) An inquiry into computers in design: attitudes
beforeeattitudes after Design Studies Vol 22 No 3 pp 255e281
Hasdogan, G (1997) Scenario building as part of the design process in McGrory P
(ed) The challenge of complexity University of Arts and Design, Helsinki pp
134e141
Hummels, C (2000) Gestural design tools: prototypes, experiments and scenarios
University of Technology Publications, Delft
Igarashi, T and Hughes, J (2003) Clothing manipulation, in ACM SIGGRAPH
2003, UIST and I3D reprise session, San Diego p 67
Jorgensen, D (1989) Participant observatione
a methodology for human studies
Sage Publications, Newbury Park
Mackay, C, Cox, T, Burrows, G and Lazzerini, T (1978) An inventory for the
measurement of self-reported stress and arousal Journal of Social and Clinical
Psychology Vol 17 No 2 pp 283e284
Pedgley, O and Wormald, P (2007) Integration of design projects within a PhD
Design Issues Vol 23 No 3 pp 70e85
Philips Design (1996) Vision of the future V&K Publishing, Blaricum
Reachin Technologies AB (2007) available at: http://www.reachin.se (accessed 6
June 2007)
Sener, B (2007) Rethinking digital industrial design: a mandate for virtual work-
shops and intelligent environments Digital Creativity Vol 18 No 4 pp 193e206
Sener, B (2004) Enhancing the form creation capabilities of digital industrialdesign tools, PhD thesis, Loughborough University, UK
Sener, B, Wormald, P and Campbell, I (2002) Evaluating a haptic modelling
system with industrial designers in Wall S, Riedel B, Crossan A and McGee M
(eds) Proceedings of the 2002 EuroHaptics International Conference Edinburgh,
University of Edinburgh pp 165e170
SensAble Technologies Inc (2007) available at: http://www.sensable.com (accessed
6 June 2007)
Shillito, A, Scali, S and Wright, M (2003) Haptics: for a more experiential quality
in a computer interface, in Fifth European Academy of Design Conference 28e30
April 2003, Barcelona, available at: http://www.ub.es/5ead/PDF/9/ShillitoSW.pdf
(accessed 6 June 2007)
Tovey, M (2002) Concept design CAD for the automotive industry Journal of
Engineering Design Vol 13 No 1 pp 5e18
Ulrich, K and Eppinger, S (1995) Product design and development McGraw-Hill,
New York
Verplank, B (2003) Interaction design sketchbook available at: http://ccrma.
stanford.edu/courses/250a-fall-2004/IDSketchbok.pdf (accessed 6 June 2007)
User evaluation of HCI concepts for defining product form 29
http://aces.shu.ac.uk/ahrchttp://www.autodesk.com/http://www.enactivenetwork.org/http://www.enactivenetwork.org/http://www.reachin.se/http://www.sensable.com/http://www.ub.es/5ead/PDF/9/ShillitoSW.pdfhttp://ccrma.stanford.edu/courses/250a-fall-2004/IDSketchbok.pdfhttp://ccrma.stanford.edu/courses/250a-fall-2004/IDSketchbok.pdfhttp://ccrma.stanford.edu/courses/250a-fall-2004/IDSketchbok.pdfhttp://ccrma.stanford.edu/courses/250a-fall-2004/IDSketchbok.pdfhttp://www.ub.es/5ead/PDF/9/ShillitoSW.pdfhttp://www.sensable.com/http://www.reachin.se/http://www.enactivenetwork.org/http://www.enactivenetwork.org/http://www.autodesk.com/http://aces.shu.ac.uk/ahrc