Abstract

Product evaluation throughout the design process is a fundamental task for product success, which also helps to reduce design-related costs. Physical prototyping is a common method to assess design alternatives, but often requires significant amounts of time and money. Extended reality (XR) technologies are changing how products are presented to the user, making virtual prototyping an effective tool for product evaluation. However, it is generally assumed that our perceptual and emotional responses to a product viewed in an XR modality are comparable to those elicited by the physical product. This paper reports the results of a study where a group of participants evaluated three designs of a product (i.e., umbrella stands) when viewed in a real setting, virtual reality (VR), and VR with passive haptics. Our goal was to observe the influence of visual media in product perception, and how the use of a complementary item (i.e., a physical umbrella) for interaction as well as user design expertise influence product assessment. Results show that the Jordan’s psycho-pleasure category of assessment was the most affected by the presentation medium, whereas the ideo-pleasure category was the only category not influenced by the medium. We also highlight that the use of VR with passive haptics could be an effective tool for product evaluation, as illustrated by the study of umbrella stands and young consumers. Our study also shows that the user’s background does not influence the level of confidence in their responses, but it can influence the assessment of certain product features. Finally, the use of a complementary item for interaction may have a significant effect on product perception.

References

1.
Coutts
,
E. R.
,
Wodehouse
,
A.
, and
Robertson
,
J.
,
2019
, “
A Comparison of Contemporary Prototyping Methods
,”
Proceedings of the Design Society: International Conference on Engineering Design
, July 26,
pp. 1313–1322
.
2.
Tiainen
,
T.
,
Ellman
,
A.
, and
Kaapu
,
T.
,
2014
, “
Virtual Prototypes Reveal More Development Ideas: Comparison Between Customers’ Evaluation of Virtual and Physical Prototypes: This Paper Argues That Virtual Prototypes Are Better Than Physical Prototypes for Consumers-Involved Product Development
,”
Virtual Phys. Prototyp.
,
9
(
3
), pp.
169
180
.
3.
Ye
,
J.
,
Badiyani
,
S.
,
Raja
,
V.
, and
Schlegel
,
T.
,
2007
, “
Applications of Virtual Reality in Product Design Evaluation
,”
Human–Computer Interaction. HCI Applications and Services
,
Beijing, China
,
July 22–27
, pp.
1190
1199
.
4.
Lau
,
H. Y. K.
,
Mak
,
K. L.
, and
Lu
,
M. T. H.
,
2003
, “
A Virtual Design Platform for Interactive Product Design and Visualization
,”
J. Mater. Process. Technol.
,
139
(
1–3
), pp.
402
407
.
5.
Evans
,
G.
,
Hoover
,
M.
, and
Winer
,
E.
,
2020
, “
Development of a 3D Conceptual Design Environment Using a Head Mounted Display Virtual Reality System
,”
J. Softw. Eng. Appl.
,
13
(
10
), pp.
258
277
.
6.
Cooper
,
R. G.
,
2019
, “
The Drivers of Success in New-Product Development
,”
Ind. Mark. Manag.
,
76
, pp.
36
47
.
7.
Bordegoni
,
M.
,
2011
, “Product Virtualization: An Effective Method for theEvaluation of Concept Design of New Products,”
Innovation in Product Design
,
M.
Bordegoni
and
C.
Rizzi
, eds.,
Springer
,
London
, pp.
117
141
.
8.
Hannah
,
R.
,
Joshi
,
S.
, and
Summers
,
J. D.
,
2012
, “
A User Study of Interpretability of Engineering Design Representations
,”
J. Eng. Des.
,
23
(
6
), pp.
443
468
.
9.
Chu
,
C.-H.
, and
Kao
,
E.-T.
,
2020
, “
A Comparative Study of Design Evaluation With Virtual Prototypes Versus a Physical Product
,”
Appl. Sci.
,
10
(
14
), p.
4723
.
10.
Virzi
,
R. A.
,
Sokolov
,
J. L.
, and
Karis
,
D.
,
1996
, “
Usability Problem Identification Using Both Low- and High-Fidelity Prototypes
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Common Ground—CHI ‘96
,
Vancouver, Canada
,
Apr. 13–18
, pp. 236–243.
11.
Gibson
,
I.
,
Gao
,
Z.
, and
Campbell
,
I.
,
2004
, “
A Comparative Study of Virtual Prototyping and Physical Prototyping
,”
Int. J. Manuf. Technol. Manage.
,
6
(
6
), pp.
503
522
.
12.
Berni
,
A.
,
Maccioni
,
L.
, and
Borgianni
,
Y.
,
2020
, “
An Eye-Tracking Supported Investigation Into the Role of Forms of Representation on Design Evaluations and Affordances of Original Product Features
,”
Proceedings of the Design Society: DESIGN Conference
,
Cavtat, Croatia
,
Oct. 26–29
, pp. 1607–1616.
13.
Cecil
,
J.
, and
Kanchanapiboon
,
A.
,
2007
, “
Virtual Engineering Approaches in Product and Process Design
,”
Int. J. Adv. Manuf. Technol.
,
31
(
9–10
), pp.
846
856
.
14.
Kent
,
L.
,
Snider
,
C.
,
Gopsill
,
J.
, and
Hicks
,
B.
,
2021
, “
Mixed Reality in Design Prototyping: A Systematic Review
,”
Des. Stud.
,
77
, p.
101046
.
15.
Ranaweera
,
A. T.
,
Martin
,
B. A. S.
, and
Jin
,
H. S.
,
2021
, “
What You Touch, Touches You: The Influence of Haptic Attributes on Consumer Product Impressions
,”
Psychol. Mark.
,
38
(
1
), pp.
183
195
.
16.
Jerald
,
J.
,
2015
, “What is Virtual Reality?,”
The VR Book
,
M.
Tamer Özsu
, ed.,
Association for Computing Machinery Books
,
New York
, p.
9
.
17.
Wang
,
J.
, and
Lu
,
W. F.
,
2012
, “
A Haptics-Based Virtual Simulation System for Product Design
,”
Int. J. Comput. Appl. Technol.
,
45
(
2–3
), pp.
163
170
.
18.
Kreimeier
,
J.
,
Hammer
,
S.
,
Friedmann
,
D.
,
Karg
,
P.
,
Bühner
,
C.
,
Bankel
,
L.
,
Götzelmann
,
T.
, et al
,
2019
, “
Evaluation of Different Types of Haptic Feedback Influencing the Task-Based Presence and Performance in Virtual Reality
,”
Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments
,
Rhodes, Greece
,
June 5–7
, pp. 289–298.
19.
Stamer
,
M.
,
Michaels
,
J.
, and
Tümler
,
J.
,
2020
, “
Investigating the Benefits of Haptic Feedback During In-Car Interactions in Virtual Reality
,”
HCI in Mobility, Transport, and Automotive Systems. Automated Driving and In-Vehicle Experience Design
,
Copenhagen, Denmark
,
July 19–24
, pp.
404
416
.
20.
Lindeman
,
R. W.
,
Sibert
,
J. L.
, and
Hahn
,
J. K.
,
1999
, “
Hand-Held Windows: Towards Effective 2D Interaction in Immersive Virtual Environments
,”
Proceedings of the Virtual Reality Annual International Symposium
,
Houston, TX
,
Mar. 13–17
.
21.
Insko
,
B. E.
,
2001
,
Passive Haptics Significantly Enhances Virtual Environments
,
University of North Carolina
,
Chapel Hill, NC
.
22.
Artacho-Ramírez
,
M. A.
,
Diego-Mas
,
J. A.
, and
Alcaide-Marzal
,
J.
,
2008
, “
Influence of the Mode of Graphical Representation on the Perception of Product Aesthetic and Emotional Features: An Exploratory Study
,”
Int. J. Ind. Ergon.
,
38
(
11–12
), pp.
942
952
.
23.
Palacios-Ibáñez
,
A.
,
Ochando-Martí
,
F.
,
Camba
,
J. D.
, and
Contero
,
M.
,
2022
, “
The Influence of the Visualization Modality on Consumer Perception: A Case Study on Household Products
,”
13th International Conference on Applied Human Factors and Ergonomics
,
New York
,
July 24–28
, Vol. 49, pp. 160–166http://doi.org/10.54941/ahfe1002050.
24.
Galán
,
J.
,
Felip
,
F.
,
García-García
,
C.
, and
Contero
,
M.
,
2021
, “
The Influence of Haptics When Assessing Household Products Presented in Different Means: A Comparative Study in Real Setting, Flat Display, and Virtual Reality Environments With and Without Passive Haptics
,”
J. Comput. Des. Eng.
,
8
(
1
), pp.
330
342
.
25.
Galán
,
J.
,
García-García
,
C.
,
Felip
,
F.
, and
Contero
,
M.
,
2021
, “
Does a Presentation Media Influence the Evaluation of Consumer Products? A Comparative Study to Evaluate Virtual Reality, Virtual Reality With Passive Haptics and a Real Setting
,”
Int. J. Interact. Multimed. Artif. Intell.
,
6
(
6
), p.
196
.
26.
Felip
,
F.
,
Galán
,
J.
,
García-García
,
C.
, and
Mulet
,
E.
,
2019
, “
Influence of Presentation Means on Industrial Product Evaluations With Potential Users: A First Study by Comparing Tangible Virtual Reality and Presenting a Product in a Real Setting
,”
Virtual Real.
,
24
(
3
), pp.
439
451
.
27.
Serrano
,
B.
,
Botella
,
C.
,
Baños
,
R. M.
, and
Alcañiz
,
M.
,
2013
, “
Using Virtual Reality and Mood-Induction Procedures to Test Products With Consumers of Ceramic Tiles
,”
Comput. Hum. Behav.
,
29
(
3
), pp.
648
653
.
28.
Steuer
,
J.
,
1992
, “
Defining Virtual Reality: Dimensions Determining Telepresence
,”
J. Commun.
,
42
(
4
), pp.
73
93
.
29.
Zubair
,
S.
,
Ansari
,
A.
,
Shukla
,
V. K.
,
Saxena
,
K.
, and
Filomeno
,
B.
,
2022
,
Implementing Virtual Reality in Entertainment Industry
, Vol.
291
,
Springer Singapore
,
Singapore
.
30.
Aziz
,
H.
,
2018
, “
Virtual Reality Programs Applications in Healthcare
,”
J. Health Med. Informat.
,
9
(
1
), p.
305
.
31.
Camba
,
J. D.
,
Soler
,
J. L.
, and
Contero
,
M.
,
2017
, “Immersive Visualization Technologies to Facilitate Multidisciplinary Design Education,”
International Conference on Learning and Collaboration Technologies
, Vol.
10295
,
P.
Zaphiris
and
A.
Ioannou
, eds.,
Springer International Publishing
,
Cham
, pp.
3
11
.
32.
Park
,
J.
,
Lennon
,
S. J.
, and
Stoel
,
L.
,
2005
, “
On-Line Product Presentation: Effects on Mood, Perceived Risk, and Purchase Intention
,”
Psychol. Mark.
,
22
(
9
), pp.
695
719
.
33.
Kuliga
,
S. F.
,
Thrash
,
T.
,
Dalton
,
R. C.
, and
Hölscher
,
C.
,
2015
, “
Virtual Reality As an Empirical Research Tool—Exploring User Experience in a Real Building and a Corresponding Virtual Model
,”
Comput. Environ. Urban Syst.
,
54
, pp.
363
375
.
34.
Berni
,
A.
, and
Borgianni
,
Y.
,
2020
, “
Applications of Virtual Reality in Engineering and Product Design: Why, What, How, When and Where
,”
Electronics
,
9
(
7
), pp.
1
29
.
35.
Kamil
,
M. J. M.
, and
Abidin
,
S. Z.
,
2013
, “
Unconscious Human Behavior at Visceral Level of Emotional Design
,”
Procedia – Soc. Behav. Sci.
,
105
, pp.
149
161
.
36.
Aftab
,
M.
, and
Rusli
,
H. A.
,
2017
, “
Designing Visceral, Behavioural and Reflective Products
,”
Chin. J. Mech. Eng.
,
30
(
5
), pp.
1058
1068
.
37.
Li
,
S. M.
,
Chan
,
F. T. S.
,
Tsang
,
Y. P.
, and
Lam
,
H. Y.
,
2021
, “
New Product Idea Selection in the Fuzzy Front End of Innovation: A Fuzzy Best-Worst Method and Group Decision-Making Process
,”
Mathematics
,
9
(
4
), pp.
1
18
.
38.
Desmet
,
P.
,
Overbeeke
,
K.
, and
Tax
,
S.
,
2001
, “
Designing Products With Added Emotional Value: Development and Application of an Approach for Research Through Design
,”
Des. J.
,
4
(
1
), pp.
32
47
.
39.
Holbrook
,
M. B.
,
1986
,
Emotion in the Consumption Experience: Toward a New Model of the Human Consumer
, Vol.
6
,
Lexington Books
,
Lanham, MD
.
40.
Desmet
,
P.
,
2007
, “
Nine Sources of Product Emotion
,”
International Association of Societies of Design Research
,
Hung Hom, Hong Kong
,
Nov. 12–15
.
41.
Tiger
,
L.
,
1992
,
The Pursuit of Pleasure
,
Little, Brown & Company
,
Boston
.
42.
Desmet
,
P.
,
2002
,
Designing Emotions
,
Delft University of Technology
,
Delft, The Netherlands
.
43.
Norman
,
D. A.
,
2004
,
Emotional Design
,
Basic Books
,
New York
.
44.
Söderman
,
M.
,
2005
, “
Virtual Reality in Product Evaluations With Potential Customers: An Exploratory Study Comparing Virtual Reality With Conventional Product Representations
,”
J. Eng. Des.
,
16
(
3
), pp.
311
328
.
45.
Reid
,
T. N.
,
MacDonald
,
E. F.
, and
Du
,
P.
,
2013
, “
Impact of Product Design Representation on Customer Judgment
,”
ASME J. Mech. Des.
,
135
(
9
), p. 091008.
46.
Agost
,
M. J.
,
Vergara
,
M.
, and
Bayarri
,
V.
,
2021
, “
The Use of New Presentation Technologies in Electronic Sales Environments and Their Influence on Product Perception
,”
International Conference on Human–Computer Interaction
,
Virtual Event
,
July 24–29
, pp. 3–15.
47.
Sylcott
,
B.
,
Orsborn
,
S.
, and
Cagan
,
J.
,
2016
, “
The Effect of Product Representation in Visual Conjoint Analysis
,”
ASME J. Mech. Des.
,
138
(
10
), p.
101104
.
48.
Ray
,
S.
, and
Choi
,
Y. M.
,
2017
, “
Employing Design Representations for Userfeedback in the Product Design Lifecycle
,”
DS 87-4 Proceedings of the 21st International Conference on Engineering Design (ICED 17), Design Methods and Tools, Vol. 4
,
Vancouver, Canada
,
Aug. 21–25
, pp.
563
572
.
49.
Palacios-Ibáñez
,
A.
,
Navarro-Martínez
,
R.
,
Blasco-Esteban
,
J.
,
Contero
,
M.
, and
Camba
,
J. D.
,
2022
, “
On the Application of Extended Reality Technologies for the Evaluation of Product Characteristics During the Initial Stages of the Product Development Process
,”
Comput. Ind.
,
144
, p.
103780
(in press).
50.
Forbes
,
T.
,
Barnes
,
H.
,
Kinnell
,
P.
, and
Goh
,
M.
,
2018
, “
A Study Into the Influence of Visual Prototyping Methods and Immersive Technologies on the Perception of Abstract Product Properties
,”
DS 91: Proceedings of NordDesign 2018
,
Linköping, Sweden
,
Aug. 14–17
.
51.
Whitfield
,
A.
, and
Wiltshire
,
J.
,
1982
, “
Design Training and Aesthetic Evaluation: An Intergroup Comparison
,”
J. Environ. Psychol.
,
2
(
2
), pp.
109
117
.
52.
Solso
,
R. L.
,
2001
, “
Brain Activities in a Skilled Versus a Novice Artist: An fMRI Study
,”
Leonardo
,
34
(
1
), pp.
31
34
.
53.
Nodine
,
C. F.
,
Locher
,
P. J.
, and
Krupinski
,
E. A.
,
1993
, “
The Role of Formal Art Training on Perception and Aesthetic Judgment of Art Compositions
,”
Leonardo
,
26
(
3
), p.
219
.
54.
Solso
,
R. L.
,
Vogt
,
S.
, and
Magnussen
,
S.
,
2007
, “
Expertise in Pictorial Perception: Eye-Movement Patterns and Visual Memory in Artists and Laymen
,”
Leonardo
,
36
(
1
), pp.
91
100
.
55.
Hsu
,
S. H.
,
Chuang
,
M. C.
, and
Chang
,
C. C.
,
2000
, “
A Semantic Differential Study of Designers’ and Users’ Product Form Perception
,”
Int. J. Ind. Ergon.
,
25
(
4
), pp.
375
391
.
56.
Grohmann
,
B.
,
Spangenberg
,
E. R.
, and
Sprott
,
D. E.
,
2007
, “
The Influence of Tactile Input on the Evaluation of Retail Product Offerings
,”
J. Retail.
,
83
(
2
), pp.
237
245
.
57.
Peck
,
J.
, and
Childers
,
T. L.
,
2003
, “
To Have and to Hold: The Influence of Haptic Information on Product Judgments
,”
J. Mark.
,
67
(
2
), pp.
35
48
.
58.
Hagtvedt
,
H.
, and
Adam Brasel
,
S.
,
2017
, “
Color Saturation Increases Perceived Product Size
,”
J. Consum. Res.
,
44
(
2
), p.
ucx039
.
59.
Slater
,
M.
,
McCarthy
,
J.
, and
Maringelli
,
F.
,
1998
, “
The Influence of Body Movement on Subjective Presence in Virtual Environments
,”
Hum. Factors J. Hum. Factors Ergon. Soc.
,
40
(
3
), pp.
469
477
.
60.
Osgood
,
C. E.
,
Suci
,
G. J.
, and
Tannenbaum
,
P. H.
,
1957
,
The Measurement of the Meaning
,
University of Illinois Press
,
Champaign, IL
.
61.
Vergara
,
M.
,
Mondragón
,
S.
,
Sancho-Bru
,
J. L.
,
Company
,
P.
, and
Agost
,
M. J.
,
2011
, “
Perception of Products by Progressive Multisensory Integration. A Study on Hammers
,”
Appl. Ergon.
,
42
(
5
), pp.
652
664
.
62.
Jordan
,
P. W.
,
2002
,
Designing Pleasurable Products: An Introduction to the New Human Factors
,
CRC Press
,
London
.
63.
Higgins
,
J. J.
,
Blair
,
R. C.
, and
Tashtoush
,
S.
,
1990
, “
The Aligned Rank Transform Procedure
,”
Conference on Applied Statistics in Agriculture
,
Kansas, MO
, pp. 185–195.
64.
Mansouri
,
H.
,
Paige
,
R. L.
, and
Surles
,
J. G.
,
2004
, “
Aligned Rank Transform Techniques for Analysis of Variance and Multiple Comparisons
,”
Commun. Stat. – Theory Methods
,
33
(
9 Spec. Iss.
), pp.
2217
2232
.
65.
O’Keefe
,
R. M.
, and
McEachern
,
T.
,
1998
, “
Web-Based Customer Decision Support Systems
,”
Commun. ACM
,
41
(
3
), pp.
71
78
.
66.
Ant Ozok
,
A.
, and
Komlodi
,
A.
,
2009
, “
Better in 3D? An Empirical Investigation of User Satisfaction and Preferences Concerning Two-Dimensional and Three-Dimensional Product Representations in Business-to-Consumer e-Commerce
,”
Int. J. Hum. Comput. Interact.
,
25
(
4
), pp.
243
281
.
67.
Marquis
,
J.
, and
Deeb
,
R. S.
,
2018
, “
Roadmap to a Successful Product Development
,”
IEEE Eng. Manage. Rev.
,
46
(
4
), pp.
51
58
.
68.
Achiche
,
S.
,
Maier
,
A.
,
Milanova
,
K.
, and
Vadean
,
A.
,
2014
, “
Visual Product Evaluation: Using the Semantic Differential to Investigate the Influence of Basic Geometry on User Perception
,”
ASME International Mechanical Engineering Congress and Exposition
,
Montreal, Canada
,
Nov. 14–20
, pp.
1
10
.
69.
Hauk
,
N.
,
Hüffmeier
,
J.
, and
Krumm
,
S.
,
2018
, “
Ready to Be a Silver Surfer? A Meta-Analysis on the Relationship Between Chronological Age and Technology Acceptance
,”
Comput. Human Behav.
,
84
, pp.
304
319
.
You do not currently have access to this content.