Abstract

Knowledge collection, extraction, and organization are critical activities in all aspects of the engineering design process. However, it remains challenging to surface and organize design knowledge, which often contains implicit or tacit dimensions that are difficult to capture in a scalable and accessible manner. Knowledge graphs (KGs) have been explored to address this issue, but have been primarily semantic in nature in engineering design contexts, typically focusing on sharing explicit knowledge. Our work seeks to understand knowledge organization during an experiential activity and how it can be transformed into a scalable representation. To explore this, we examine 23 professional designers’ knowledge organization practices as they virtually engage with data collected during a teardown of a consumer product. Using this data, we develop a searchable knowledge graph as a mechanism for representing the experiential knowledge and afford its use in complex queries. We demonstrate the knowledge graph with two extended examples to reveal insights and patterns from design knowledge. These findings provide insight into professional designers’ knowledge organization practices and represent a preliminary step toward design knowledge bases that more accurately reflect designer behavior, ultimately enabling more effective data-driven support tools for design.

References

1.
Beckman
,
S. L.
, and
Barry
,
M.
,
2007
, “
Innovation as a Learning Process: Embedding Design Thinking
,”
Calif. Manage. Rev.
,
50
(
1
), pp.
25
56
.
2.
Mistree
,
F.
,
Smith
,
W.
,
Bras
,
B.
,
Allen
,
J.
, and
Muster
,
D.
,
1990
, “
Decision-Based Design: A Contemporary Paradigm for Ship Design
,”
Trans. Soc. Nav. Archit. Mar. Eng.
,
98
, pp.
565
597
.
3.
Heisig
,
P.
,
Caldwell
,
N. H.
,
Grebici
,
K.
, and
Clarkson
,
P. J.
,
2010
, “
Exploring Knowledge and Information Needs in Engineering From the Past and for the Future–Results From a Survey
,”
Des. Stud.
,
31
(
5
), pp.
499
532
.
4.
Qian
,
L.
, and
Gero
,
J. S.
,
1996
, “
Function-Behavior-Structure Paths and Their Role in Analogy-Based Design
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
10
(
4
), pp.
289
312
.
5.
Hatchuel
,
A.
, and
Weil
,
B.
,
2009
, “
CK Design Theory: An Advanced Formulation
,”
Res. Eng. Des.
,
19
(
4
), pp.
181
192
.
6.
Robinson
,
M. A.
,
2010
, “
An Empirical Analysis of Engineers’ Information Behaviors
,”
J. Am. Soc. Inf. Sci. Technol.
,
61
(
4
), pp.
640
658
.
7.
Barao
,
A.
,
de Vasconcelos
,
J. B.
,
Rocha
,
A.
, and
Pereira
,
R.
,
2017
, “
A Knowledge Management Approach to Capture Organizational Learning Networks
,”
Int. J. Inf. Manage.
,
37
(
6
), pp.
735
740
.
8.
Adams
,
M.
, and
Oleksak
,
M.
,
2010
,
Intangible Capital: Putting Knowledge to Work in the 21st-Century Organization: Putting Knowledge to Work in the 21st-Century Organization
,
ABC-CLIO
,
Santa Barbara, CA
, pp.
77
107
.
9.
Goncher
,
A.
,
Johri
,
A.
,
Kothaneth
,
S.
, and
Lohani
,
V.
,
2009
, “
Exploration and Exploitation in Engineering Design: Examining the Effects of Prior Knowledge on Creativity and Ideation
,”
39th IEEE Frontiers in Education Conference
,
San Antonio, TX
,
Oct. 18–21
, pp.
1
7
.
10.
Kleinsmann
,
M.
,
Maier
,
A.
,
Roschuni
,
C.
,
Goodman
,
E.
, and
Agogino
,
A. M.
,
2013
, “
Communicating Actionable User Research for Human-Centered Design
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
27
(
2
), p.
143
.
11.
Yassine
,
A.
, and
Braha
,
D.
,
2003
, “
Complex Concurrent Engineering and the Design Structure Matrix Method
,”
Concurr. Eng.
,
11
(
3
), pp.
165
176
.
12.
Boston
,
O.
,
Court
,
A.
,
Culley
,
S.
,
McMahon
,
C.
, and
Duffy
,
A. H. B.
,
1998
, “Design Information Issues in New Product Development,”
The Design Productivity Debate
,
Springer
,
London
, pp.
231
254
.
13.
Chandrasegaran
,
S. K.
,
Ramani
,
K.
,
Sriram
,
R. D.
,
Horváth
,
I.
,
Bernard
,
A.
,
Harik
,
R. F.
, and
Gao
,
W.
,
2013
, “
The Evolution, Challenges, and Future of Knowledge Representation in Product Design Systems
,”
Comput. Aided Des.
,
45
(
2
), pp.
204
228
.
14.
Hicks
,
B. J.
,
Culley
,
S. J.
,
Allen
,
R. D.
, and
Mullineux
,
G.
,
2002
, “
A Framework for the Requirements of Capturing, Storing and Reusing Information and Knowledge in Engineering Design
,”
Int. J. Inf. Manage.
,
22
(
4
), pp.
263
280
.
15.
Zaglago
,
L.
,
Chapman
,
C.
, and
Shah
,
H.
,
2016
, “
Barriers Virtual Design Team Knowledge Sharing
,”
Proceedings of the World Congress on Engineering
,
London, UK
,
June 29–July 1
, pp.
239
244
.
16.
Ozimek
,
A.
,
2020
, “
The Future of Remote Work
,” Available at SSRN 3638597.
17.
Sarica
,
S.
,
Luo
,
J.
, and
Wood
,
K. L.
,
2020
, “
TechNet: Technology Semantic Network Based on Patent Data
,”
Expert Syst. Appl.
,
142
, p.
112995
.
18.
Speer
,
R.
,
Chin
,
J.
, and
Havasi
,
C.
,
2017
, “
ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
,”
31st AAAI Conference on Artificial Intelligence
,
San Francisco, CA
,
Feb. 4–9
.
19.
Murphy
,
J.
,
Fu
,
K.
,
Otto
,
K.
,
Yang
,
M.
,
Jensen
,
D.
, and
Wood
,
K.
,
2014
, “
Function Based Design-By Analogy: A Functional Vector Approach to Analogical Search
,”
ASME J. Mech. Des.
,
136
(
10
), p.
101102
.
20.
Wölfel
,
C.
,
2008
, “
How Industrial Design Knowledge Differs From Engineering Design Knowledge
,”
Proceedings of the International Conference on Engineering and Product Design Education
,
Barcelona, Spain
,
Sept. 4–5
.
21.
Kolb
,
D. A.
,
2014
,
Experiential Learning: Experience as the Source of Learning and Development
, 2nd ed.,
Pearson FT Press
,
Upper Saddle River, NJ
, pp.
1
65
.
22.
Otto
,
K. N.
, and
Wood
,
K. L.
,
2001
,
Product Design: Techniques in Reverse Engineering and New Product Development
,
Prentice Hall
,
Hoboken, NJ
, pp.
197
259
.
23.
Sato
,
Y.
, and
Kaufman
,
J. J.
,
2005
,
Value Analysis Tear-Down: A New Process for Product Development and Innovation
,
Industrial Press Inc
,
New York
, pp.
1
21
.
24.
Wang
,
W.
,
2010
,
Reverse Engineering: Technology of Reinvention
,
CRC Press
,
Boca Raton, FL
, pp.
1
25
.
25.
Otto
,
K.
, and
Wood
,
K.
,
1996
, “
A Reverse Engineering and Redesign Methodology for Product Evolution
,”
Proceedings of the ASME IDETC
,
ASME Digital Collection
, Paper No. 96-DETC/DTM-1523.
26.
Starkey
,
E. M.
,
McKay
,
A. S.
,
Hunter
,
S. T.
, and
Miller
,
S. R.
,
2018
, “
Piecing Together Product Dissection: How Dissection Conditions Impact Student Conceptual Understanding and Cognitive Load
,”
ASME J. Mech. Des.
,
140
(
5
). p.
052001
.
27.
Wood
,
K. L.
,
Jensen
,
D.
,
Bezdek
,
J.
, and
Otto
,
K. N.
,
2001
, “
Reverse Engineering and Redesign: Courses to Incrementally and Systematically Teach Design
,”
J. Eng. Educ.
,
90
(
3
), pp.
363
374
.
28.
Dalrymple
,
O. O.
,
Sears
,
D. A.
, and
Evangelou
,
D.
,
2011
, “
The Motivational and Transfer Potential of Disassemble/Analyze/Assemble Activities
,”
J. Eng. Educ.
,
100
(
4
), pp.
741
759
.
29.
Frank
,
D.
,
1999
, “
The Importance of Knowledge Management for BMW
,”
Proceedings of the International Conference on Engineering Design (ICED)
,
Munich, Germany
,
Aug. 24–26
, pp.
24
26
.
30.
Benson
,
M.
, and
Terpenny
,
J.
,
2001
, “
A Survey of Methods and Approaches to Knowledge Management in the Product Development Environment
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2001/CIE21288.
31.
Brun
,
J.
,
Le Masson
,
P.
, and
Weil
,
B.
,
2018
, “
Getting Inspiration or Creating Inspiration? The Role of Knowledge Structures in Idea Generation
,”
Proceedings of the Design Society: Design Conference
,
Dubrovnik, Croatia
,
May 21–24
, pp.
1793
1804
.
32.
Harfield
,
S.
,
2007
, “
On Design ‘Problematization’: Theorising Differences in Designed Outcomes
,”
Des. Stud.
,
28
(
2
), pp.
159
173
.
33.
Ulrich
,
K.
,
1995
, “
The Role of Product Architecture in the Manufacturing Firm
,”
Res. Policy
,
24
(
3
), pp.
419
440
.
34.
Miller
,
G. A.
,
1995
, “
WordNet
,”
Commun. ACM
,
38
(
11
), pp.
39
41
.
35.
Liu
,
H.
, and
Singh
,
P.
,
2004
, “
ConceptNet—A Practical Commonsense Reasoning Tool-Kit
,”
BT Technol. J.
,
22
(
4
), pp.
211
226
.
36.
Feng
,
Y.
,
Zhao
,
Y.
,
Zheng
,
H.
,
Li
,
Z.
, and
Tan
,
J.
,
2020
, “
Data-Driven Product Design Toward Intelligent Manufacturing: A Review
,”
Int. J. Adv. Rob. Syst.
,
17
(
2
), pp.
1
18
.
37.
Shi
,
F.
,
Chen
,
L.
,
Han
,
J.
, and
Childs
,
P.
,
2017
, “
A Data-Driven Text Mining and Semantic Network Analysis for Design Information Retrieval
,”
ASME J. Mech. Des.
,
139
(
11
), p.
111402
.
38.
Angrish
,
A.
,
Craver
,
B.
, and
Starly
,
B.
,
2019
, “
“FabSearch”: A 3D CAD Model-Based Search Engine for Sourcing Manufacturing Services
,”
ASME J. Comput. Inf. Sci. Eng.
,
19
(
4
), p.
041006
.
39.
Bertoni
,
A.
,
2020
, “
Data-Driven Design in Concept Development: Systematic Review and Missed Opportunities
,”
Proceedings of the Design Society: Design Conference
, pp.
101
110
.
40.
Nandy
,
A.
,
Dong
,
A.
, and
Goucher-Lambert
,
K.
,
2022
, “
Evaluating Quantitative Measures for Assessing Functional Similarity in Engineering Design
,”
ASME J. Mech. Des.
,
144
(
3
), p.
03140
1.
41.
Rao
,
V.
,
Moore
,
G.
,
Udekwu
,
O. A.
, and
Hartmann
,
B.
,
2020
, “
Tracing Stories Across the Design Process: A Study of Engineering Students’ Engagement With Storytelling in an Undergraduate Humancentered Design Course
,”
Int. J. Eng. Educ.
,
36
(
2
), pp.
762
772
.
42.
Beckman
,
S.
, and
Barry
,
M.
,
2010
, “
Design and Innovation Through Storytelling
,”
Int. J. Innov. Sci.
,
1
(
4
), pp.
151
160
.
43.
Henderson
,
K.
,
1991
, “
Flexible Sketches and Inflexible Data Bases: Visual Communication, Conscription Devices, and Boundary Objects in Design Engineering
,”
Sci. Technol. Hum. Values
,
16
(
4
), pp.
448
473
.
44.
Suh
,
N. P.
,
1990
,
The Principles of Design
,
Oxford University Press
,
New York
.
45.
Dorst
,
K.
,
2011
, “
The Core of ‘Design Thinking’ and Its Application
,”
Des. Stud.
,
32
(
6
), pp.
521
532
.
46.
Damen
,
N. B.
, and
Toh
,
C. A.
,
2020
, “
From Information to Ideas: How Designers Structure Information to Support Idea Generation
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2020-22527.
47.
Le Masson
,
P.
,
Hatchuel
,
A.
, and
Weil
,
B.
,
2016
, “
Design Theory at Bauhaus: Teaching “Splitting” Knowledge
,”
Res. Eng. Des.
,
27
(
2
), pp.
91
115
.
48.
Goucher-Lambert
,
K.
,
Gyory
,
J. T.
,
Kotovsky
,
K.
, and
Cagan
,
J.
,
2020
, “
Adaptive Inspirational Design Stimuli: Using Design Output to Computationally Search for Stimuli That Impact Concept Generation
,”
ASME J. Mech. Des.
,
142
(
9
), p.
091401
.
49.
Chan
,
J.
,
Dow
,
S. P.
,
Schunn
,
C. D.
,
Subrahmanian
,
E.
,
Odumosu
,
T.
, and
Tsao
,
J.
,
2018
, “Do the Best Design Ideas (Really) Come From Conceptually Distant Sources of Inspiration?,”
Engineering a Better Future
,
Springer
,
Cham
, pp.
111
139
.
50.
Hatchuel
,
A.
, and
Weil
,
B.
,
2003
, “
A New Approach of Innovative Design: An Introduction to CK Theory
,”
Proceedings of the International Conference on Engineering Design (ICED).
,
Stockholm, Sweden
,
Aug. 19–21
.
51.
Gero
,
J. S.
,
1990
, “
Design Prototypes: A Knowledge Representation Schema for Design
,”
AI Mag.
,
11
(
4
), pp.
26
36
.
52.
Gero
,
J. S.
, and
Kannengiesser
,
U.
,
2004
, “
The Situated Function–Behaviour–Structure Framework
,”
Des. Stud.
,
25
(
4
), pp.
373
391
.
53.
Valverde
,
U. Y.
,
Nadeau
,
J.-P.
, and
Scaravetti
,
D.
,
2017
, “
A New Method for Extracting Knowledge From Patents to Inspire Designers During the Problem-Solving Phase
,”
J. Eng. Des.
,
28
(
6
), pp.
369
407
.
54.
Zha
,
X. F.
, and
Sriram
,
R. D.
,
2006
, “
Platform-Based Product Design and Development: A Knowledge Intensive Support Approach
,”
Knowl.-Based Syst.
,
19
(
7
), pp.
524
543
.
55.
Damen
,
N. B.
, and
Toh
,
C. A.
,
2019
, “
Investigating Information: A Qualitative Analysis of Expert Designers’ Information Representation and Structuring Behaviors
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2019-98362.
56.
Tomko
,
M.
,
Schwartz
,
A.
,
Newstetter
,
W.
,
Alemán
,
M.
,
Nagel
,
R.
, and
Linsey
,
J.
,
2018
, “
“A Makerspace is More Than Just a Room Full of Tools”: What Learning Looks Like for Female Students in Makerspaces
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2018-86276.
57.
Ehrlinger
,
L.
, and
Wöß
,
W.
,
2016
, “
Towards a Definition of Knowledge Graphs
,”
Posters&Demos@SEMANTiCS 2016 and SuCCESS'16 Workshop
,
Leipzig, Germany
,
Sept. 12–15
.
58.
Li
,
X.
,
Chen
,
C.-H.
,
Zheng
,
P.
,
Wang
,
Z.
,
Jiang
,
Z.
, and
Jiang
,
Z.
,
2020
, “
A Knowledge Graph-Aided Concept–Knowledge Approach for Evolutionary Smart Product–Service System Development
,”
ASME J. Mech. Des.
,
142
(
10
), p.
101403
.
59.
Hao
,
J.
,
Zhao
,
L.
,
Milisavljevic-Syed
,
J.
, and
Ming
,
Z.
,
2021
, “
Integrating and Navigating Engineering Design Decision-Related Knowledge Using Decision Knowledge Graph
,”
Adv. Eng. Inform.
,
50
, p.
101366
.
60.
Bhatia
,
S. K.
,
Dwivedi
,
P.
, and
Kaur
,
A.
,
2018
, “
That’s Interesting, Tell Me More! Finding Descriptive Support Passages for Knowledge Graph Relationships
,”
SEMWEB
,
Monterey, CA
,
Oct. 8–12
.
61.
Tombros
,
A.
, and
Sanderson
,
M.
,
1998
, “
Advantages of Query Biased Summaries in Information Retrieval
,”
Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
,
Melbourne, Australia
,
Aug. 24–28
, pp.
2
10
.
62.
Carbone
,
F.
,
Contreras
,
J.
,
Hernández
,
J. Z.
, and
Gomez-Perez
,
J. M.
,
2012
, “
Open Innovation in an Enterprise 3.0 Framework: Three Case Studies
,”
Expert Syst. Appl.
,
39
(
10
), pp.
8929
8939
.
63.
Huet
,
A.
,
Pinquié
,
R.
,
Véron
,
P.
,
Mallet
,
A.
, and
Segonds
,
F.
,
2021
, “
CACDA: A Knowledge Graph for a Context-Aware Cognitive Design Assistant
,”
Comput. Ind.
,
125
, p.
103377
.
64.
Song
,
H.
, and
Fu
,
K.
,
2022
, “
Design-By-Analogy: Effects of Exploration-Based Approach on Analogical Retrievals and Design Outcomes
,”
ASME J. Mech. Des.
,
144
(
6
), p.
061401
.
65.
Li
,
X.
,
Chen
,
C.-H.
,
Zheng
,
P.
,
Jiang
,
Z.
, and
Wang
,
L.
,
2021
, “
A Context-Aware Diversity-Oriented Knowledge Recommendation Approach for Smart Engineering Solution Design
,”
Knowl.-Based Syst.
,
215
, p.
106739
.
66.
Samuelson
,
P.
, and
Scotchmer
,
S.
,
2001
, “
The Law and Economics of Reverse Engineering
,”
Yale LJ
,
111
(
7
), p.
1575
.
67.
Raja
,
V.
, and
Fernandes
,
K. J.
,
2007
,
Reverse Engineering: An Industrial Perspective
,
Springer
,
London
, pp.
1
11
.
68.
Lefever
,
D. D.
, and
Wood
,
K. L.
,
1996
, “
Design for Assembly Techniques in Reverse Engineering and Redesign
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. 96-DETC/DTM-1507.
69.
Lauff
,
C. A.
,
Kotys-Schwartz
,
D.
, and
Rentschler
,
M. E.
,
2018
, “
Design Methods Used During Early Stages of Product Development: Three Company Cases
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2018-85406.
70.
Morgan
,
J.
, and
Liker
,
J. K.
,
2020
,
The Toyota Product Development System: Integrating People, Process, and Technology
,
CRC Press
,
Boca Raton, FL
.
71.
Sheppard
,
S.
,
Jenison
,
R.
,
Agogino
,
A.
,
Brereton
,
M.
,
Bocciarelli
,
L.
,
Dally
,
J.
,
Demel
,
J.
,
Dym
,
C.
,
Evans
,
D.
, and
Faste
,
R.
,
1997
, “
Examples of Freshman Design Education
,”
Int. J. Eng. Educ.
,
13
(
4
), pp.
248
261
.
72.
Bhatnagar
,
A.
,
2015
, “
Product Dissection: A Method for Hands on Engineering Education
,”
J. Eng. Educ. Transfor.
,
28
(
Special Issue
), pp.
99
104
.
73.
Simpson
,
T. W.
, and
Thevenot
,
H. J.
,
2005
, “
Using Product Dissection to Integrate Product Family Design Research Into the Classroom and Improve Students’ Understanding of Platform Commonality
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2005-84639.
74.
Starkey
,
E. M.
,
Spencer
,
C.
,
Lesniak
,
K.
,
Tucker
,
C.
, and
Miller
,
S. R.
,
2017
, “
Do Technological Advancements Lead to Learning Enhancements? An Exploration in Virtual Product Dissection
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2017-68237.
75.
Kearney
,
K. G.
,
Starkey
,
E. M.
, and
Miller
,
S. R.
,
2020
, “
Digitizing Dissection: A Case Study on Augmented Reality and Animation in Engineering Education
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2020-22773.
76.
Becker
,
K.
,
Gero
,
J.
,
Pourmohamadi
,
M.
,
Abdellahi
,
S.
,
Almeida
,
L.
, and
Luo
,
Y.
,
2018
, “
Quantifying Differences Between Professional Expert Engineers and Engineering Students Designing: Empirical Foundations for Improved Engineering Education
,”
ASEE Annual Conference & Exposition
,
Salt Lake City, UT
,
June 24–27
.
77.
Friedman
,
K.
,
2003
, “
Theory Construction in Design Research: Criteria: Approaches, and Methods
,”
Des. Stud.
,
24
(
6
), pp.
507
522
.
78.
Kearney
,
K. G.
,
Starkey
,
E. M.
, and
Miller
,
S. R.
,
2022
, “
Digitizing Product Dissection: A Case Study on Augmented Reality and Animation in Engineering Education
,”
ASME J. Mech. Des.
,
144
(
8
), p.
082301
.
79.
Shweta
,
Bajpai
,
R.C.
, and
Chaturvedi
,
H.K.
,
2015
, “
Evaluation of Inter-Rater Agreement and Inter-Rater Reliability for Observational Data: An Overview of Concepts and Methods
,”
J. Indian Acad. Appl. Psychol.
,
41
(
3
), pp.
20
27
.
80.
Keeney
,
R. L.
,
Raiffa
,
H.
, and
Meyer
,
R. F.
,
1993
,
Decisions With Multiple Objectives: Preferences and Value Trade-Offs
,
Cambridge University Press
,
Cambridge, UK
, pp.
1
30
.
81.
Wallace
,
K.
,
Ahmed
,
S.
,
Bracewell
,
R.
,
Clarkson
,
J.
, and
Eckert
,
C.
,
2005
, “Engineering Knowledge Management,”
Design Process Improvement: A review of current practice
, 1st ed.,
Springer
,
London
, pp.
326
343
.
82.
Damen
,
N. B.
, and
Toh
,
C. A.
,
2021
, “
Reflections on Designing in the Wild: How Theories of Design Information Manifest in Practice
,”
Proceedings of the ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2021-71581.
83.
Wang
,
Y.
,
Grandi
,
D.
,
Cui
,
D.
,
Rao
,
V.
, and
Goucher-Lambert
,
K.
,
2021
, “
Understanding Professional Designers’ Knowledge Organization Behavior: A Case Study in Product Teardowns
,”
Proceedings of ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2021-68589.
84.
Goridkov
,
N.
,
Rao
,
V.
,
Cui
,
D.
,
Grandi
,
D.
,
Wang
,
Y.
, and
Goucher-Lambert
,
K.
,
2022
, “
Capturing Designers’ Experiential Knowledge in Scalable Representation Systems: A Case Study of Knowledge Graphs for Product Teardowns
,”
Proceedings of ASME IDETC/CIE
,
ASME Digital Collection
, Paper No. DETC2022-90697.
You do not currently have access to this content.