Sketching and diagramming plays an important role for problem solving, knowledge transfer and acquisition. Designers of all domains (e.g., architects and engineers) sketch and diagram in their design process to perform functional reasoning and formal arrangements. Therefore, drawing can serve as a powerful interface to access knowledge-based design systems. This talk will present a computational design research framework termed "drawing marks, acts, and reacts" and show demonstrations of software tools implemented to support early conceptual design process in architecture. Applications of information retrieval, access to visual analysis and simulation, and easy creation of 3D geometry from design sketches are implemented based on the recognition of geometric shapes and spatial relationships among them.
- authors: Ellen Yi-Luen Do
- projects: Electronic Cocktail Napkin, Drawing Analogy, Back of an Envelope Design, SketchVR, Design Amanuensis, Graphics Interpreter of Design Actions, LightSketch, Light Pen, Spot, Right Tool Right Time
last updated 2.21.2005 by Ellen Yi-Luen Do
2006
Sketch-to-fabrication: Furniture Factory and Designosaur (HCII Poster)
- pdf
Gabe Johnson, Yeonjoo Oh, Mark D Gross, Ellen Yi-Luen Do
HCII 12th Anniversary Celebration Poster
Gabe Johnson, Yeonjoo Oh, Mark D Gross, Ellen Yi-Luen Do
HCII 12th Anniversary Celebration Poster
2006
Flow Selection: A Time-Based Selection and Operation Technique for Sketching Tools
- pdf
Gabe Johnson, Mark D Gross, Ellen Yi-Luen Do
Advanced Visual Interfaces 2006
Gabe Johnson, Mark D Gross, Ellen Yi-Luen Do
Advanced Visual Interfaces 2006
2005
Design Sketches and Sketch Design Tools
- pdf
Ellen Yi-Luen Do
KBS - Knowledge Based Systems (18) 383-405
Ellen Yi-Luen Do
KBS - Knowledge Based Systems (18) 383-405
2004
Design Evaluator: Critiquing Freehand Sketches
- pdf
Yeonjoo Oh, Mark D Gross, Ellen Yi-Luen Do
CoDe Lab Working Paper
Yeonjoo Oh, Mark D Gross, Ellen Yi-Luen Do
CoDe Lab Working Paper
2004
The Three Rs of Drawing and Design Computation
- pdf
Mark Gross, Ellen Yi-Luen Do
First International Conference on Design Computing and Cognition Kluwer
Mark Gross, Ellen Yi-Luen Do
First International Conference on Design Computing and Cognition Kluwer
2004
Intelligent Critiquing of Design Sketches
- pdf
Yeonjoo Oh, Ellen Yi-Luen Do, Mark D Gross
AAAI (American Association for Artificial Intelligence) Fall Symposium: Making Pen-Based Interaction Intelligent and Natural Arlington, Virginia, AAAI Press: pp. 127 - 133
Yeonjoo Oh, Ellen Yi-Luen Do, Mark D Gross
AAAI (American Association for Artificial Intelligence) Fall Symposium: Making Pen-Based Interaction Intelligent and Natural Arlington, Virginia, AAAI Press: pp. 127 - 133
2004
Design Evaluator: Critiquing Freehand Sketches
- pdf
Yeonjoo Oh
M.Science thesis, University of Washington, Seattle
Yeonjoo Oh
M.Science thesis, University of Washington, Seattle
2004
As if You Were Here - Intelligent Annotation in Space: Sketching as an Interface to Knowledge-Based Design Systems
- pdf
Ellen Yi-Luen Do, Mark D Gross
AAAI Fall Symposium - Making Pen-Based Interaction Intelligent and Natural AAAI Press, FS-04-06:pp 55-57
Ellen Yi-Luen Do, Mark D Gross
AAAI Fall Symposium - Making Pen-Based Interaction Intelligent and Natural AAAI Press, FS-04-06:pp 55-57
2004
CRITIQUING FREEHAND SKETCHING: A Computational Tool for Design Evaluation
- pdf
Yeonjoo Oh, Mark D Gross, Ellen Yi-Luen Do
Visual and Spatial Reasoning in Design III (VR '04) Cambridge, MA: pp. 105 - 120
Yeonjoo Oh, Mark D Gross, Ellen Yi-Luen Do
Visual and Spatial Reasoning in Design III (VR '04) Cambridge, MA: pp. 105 - 120
2003
2003
2003
ArchiDNA: A Generative System for Shape Configuratons
- pdf
Doo Young Kwon
Master of Science in Architecture
Doo Young Kwon
Master of Science in Architecture
2002
Sketching Annotations in a 3D Web Environment
- pdf
Thomas Jung, Mark D Gross, Ellen Yi-Luen Do
ACM Conference on Computer Human Interface
Thomas Jung, Mark D Gross, Ellen Yi-Luen Do
ACM Conference on Computer Human Interface
2002
Functional and Formal Reasoning in Architectural Sketches
- pdf
Ellen Yi-Luen Do
American Assocation for Artificial Intelligence AAAI Spring Symposium SSS02, pp 37-44
Ellen Yi-Luen Do
American Assocation for Artificial Intelligence AAAI Spring Symposium SSS02, pp 37-44
2002
Drawing Marks, Acts, and Reacts, toward a computational sketching interface for architectural design
- pdf
Ellen Yi-Luen Do
AIEDAM, Artificial Intelligence for Engineering Design, Analysis and Manufacturing 16 (3) November, 149-171
Ellen Yi-Luen Do
AIEDAM, Artificial Intelligence for Engineering Design, Analysis and Manufacturing 16 (3) November, 149-171
2001
Emergence in a Recognition Based Drawing Interface
- pdf
Mark D Gross
Proceedings of the 2nd International Conference on Visual and Spatial Reasoning '01 Bellagio, Italy
Mark D Gross
Proceedings of the 2nd International Conference on Visual and Spatial Reasoning '01 Bellagio, Italy
2001
Thinking with Diagrams in Architectural Design
- pdf
Ellen Yi-Luen Do, Mark D Gross
Artificial Intelligence Review Volume 15, Issue 1/2 March 2001 Kluwer, pp 135-149
Ellen Yi-Luen Do, Mark D Gross
Artificial Intelligence Review Volume 15, Issue 1/2 March 2001 Kluwer, pp 135-149
2001
Space Pen: Annotation and Sketching on 3D Models on the Internet
- pdf
Thomas Jung, Mark D Gross, Ellen Yi-Luen Do
CAAD Futures CAAD Futures 2001, pp257-270.
Thomas Jung, Mark D Gross, Ellen Yi-Luen Do
CAAD Futures CAAD Futures 2001, pp257-270.
2001
2001
The Design Amanuensis - An Instrument for Multimodal Design Capture and Playback
- pdf
Mark D Gross, Brian R Johnson, Ellen Yi-Luen Do
CAAD Futures CAAD Futures 2001, pp 1-13.
Mark D Gross, Brian R Johnson, Ellen Yi-Luen Do
CAAD Futures CAAD Futures 2001, pp 1-13.
2001
Graphics Interpreter of Design Actions - the GIDA system of diagram sorting and analysis
- pdf
Ellen Yi-Luen Do
CAAD Futures 'CAAD Futures 2001', Bauke de Vries, Jos P. van Leeuwen, Henri H. Achten (eds). July, 2001, Eindhoven, the Netherlands, Kluwer Academic Publishers. pp. 271-284.
Ellen Yi-Luen Do
CAAD Futures 'CAAD Futures 2001', Bauke de Vries, Jos P. van Leeuwen, Henri H. Achten (eds). July, 2001, Eindhoven, the Netherlands, Kluwer Academic Publishers. pp. 271-284.
2000
Place Based Web Resources for Historic Buildings
- pdf
Mark A. Ehrhardt and Mark D Gross
eCAADe 'Promise and Reality', proceedings of the 18th conference on Education in Computer Aided Architectural Design in Europe, June 22-24, 2000, pp177-179.
Mark A. Ehrhardt and Mark D Gross
eCAADe 'Promise and Reality', proceedings of the 18th conference on Education in Computer Aided Architectural Design in Europe, June 22-24, 2000, pp177-179.
2000
Drawing on the Back of an Envelope: a framework for interacting with application programs by freehand drawing
- pdf
Mark D Gross and Ellen Yi-Luen Do
Computers and Graphics Vol. 24 (6) (2000) pp. 835-849
Mark D Gross and Ellen Yi-Luen Do
Computers and Graphics Vol. 24 (6) (2000) pp. 835-849
2000
Digital Clay: Deriving digital models from freehand sketches
- pdf
Eric Schweikardt, Mark D Gross
Automation in Construction Vol. 9 pp107-115
Eric Schweikardt, Mark D Gross
Automation in Construction Vol. 9 pp107-115
2000
Sketch that Scene for Me: Creating Virtual Worlds by Freehand Drawing
- pdf
Ellen Yi-Luen Do
eCAADe 'Promise and Reality', proceedings of the 18th conference on Education in Computer Aided Architectural Design in Europe, June 22-24, 2000, pp265-268.
Ellen Yi-Luen Do
eCAADe 'Promise and Reality', proceedings of the 18th conference on Education in Computer Aided Architectural Design in Europe, June 22-24, 2000, pp265-268.
2000
Thesis Proposal: Development Simulator: A Tool for Architects and Urban Designers
- pdf
Doddy Samiaji
M.arch Thesis Proposal
Doddy Samiaji
M.arch Thesis Proposal
2000
Intentions in and Relations among Design Drawings
- pdf
Ellen Yi-Luen Do, Mark D Gross, Bennett Neiman, Craig Zimring
Design Studies Volume 21, Issue 5 September 2000 Elsevier, pp 483-503
Ellen Yi-Luen Do, Mark D Gross, Bennett Neiman, Craig Zimring
Design Studies Volume 21, Issue 5 September 2000 Elsevier, pp 483-503
1999
Drawing and Design Intentions -- an Investigation of freehand drawing conventions in design
- pdf
Ellen Yi-Luen Do, Mark D Gross, and Craig Zimring
Design Thinking Research Symposium 'Design Representation', proceedings of 4th Design Thinking Research Symposium 1999, MIT, Cambridge, MA, USA pp1-10
Ellen Yi-Luen Do, Mark D Gross, and Craig Zimring
Design Thinking Research Symposium 'Design Representation', proceedings of 4th Design Thinking Research Symposium 1999, MIT, Cambridge, MA, USA pp1-10
1999
Collaborative Design with NetDraw
- pdf
Dongqiu Qian and Mark D Gross
CAAD Futures 'Computers in Building', proceedings of CAAD Futures 1999 Conference, Georgia Institute of Technology, Atlanta, Georgia, USA, June 7-8, 1999 pp213-226
Dongqiu Qian and Mark D Gross
CAAD Futures 'Computers in Building', proceedings of CAAD Futures 1999 Conference, Georgia Institute of Technology, Atlanta, Georgia, USA, June 7-8, 1999 pp213-226
1999
Sketches and Their Functions in Early Design: A Retrospective Analysis of a Pavilion House
- pdf
Bennett Neiman, Ellen Yi-Luen Do, and Mark D Gross
Design Thinking Research Symposium 'Design Representation', proceedings of 4th Design Thinking Research Symposium 1999, MIT, Cambridge, MA, USA, August 23-25, 1999 pp255-266
Bennett Neiman, Ellen Yi-Luen Do, and Mark D Gross
Design Thinking Research Symposium 'Design Representation', proceedings of 4th Design Thinking Research Symposium 1999, MIT, Cambridge, MA, USA, August 23-25, 1999 pp255-266
1999
Immersive redlining and annotation of 3D design models on the Web
- pdf
Thomas Jung, Ellen Yi-Luen Do and Mark D Gross
CAAD Futures Computers in Building, proceedings of CAAD Futures 1999 Conference, Georgia Institute of Technology, Atlanta, Georgia, USA, June 7-8, 1999 pp81-98
Thomas Jung, Ellen Yi-Luen Do and Mark D Gross
CAAD Futures Computers in Building, proceedings of CAAD Futures 1999 Conference, Georgia Institute of Technology, Atlanta, Georgia, USA, June 7-8, 1999 pp81-98
1998
1998
Digital Clay: Deriving Digital Models from Freehand Sketches, in ACADIA
- pdf
Eric Schweikardt and Mark D Gross
ACADIA 'Digital Design Studios: Do Computers Make A Difference?', proceedings of ACADIA 1998, Quebec City, CANADA October 22-25, 1998 pp202-211
Eric Schweikardt and Mark D Gross
ACADIA 'Digital Design Studios: Do Computers Make A Difference?', proceedings of ACADIA 1998, Quebec City, CANADA October 22-25, 1998 pp202-211
1998
Representational Talkback: An Approach to Support Writing as Design
- pdf
Y Yamamoto, Mark D Gross, S Takada, K Nakakoji
Asia Pacific Computer Human Interaction Conference from the proceedings of the 1998 Asia Pacific Computer Human Interaction Conference (APCHI 98)) 15-17 July 1998, Kanagawa, Japan
Y Yamamoto, Mark D Gross, S Takada, K Nakakoji
Asia Pacific Computer Human Interaction Conference from the proceedings of the 1998 Asia Pacific Computer Human Interaction Conference (APCHI 98)) 15-17 July 1998, Kanagawa, Japan
1998
Interactive Systems for Supporting the Emergence of Concepts and IdeasConcepts and Ideas
Ernest Edmonds, Thomas Moran & Ellen Yi-Luen Do
SIGCHI Bulletin 30:1
Ernest Edmonds, Thomas Moran & Ellen Yi-Luen Do
SIGCHI Bulletin 30:1
1997
Inferring Design Intentions from Sketches
- pdf
Ellen Yi-Luen Do and Mark D Gross
proceedings of Computer Aided Architectural Design Research In Asia(CAADRIA1997) National Chiao Tung University, Hsinchu, Taiwan April 1997 pp 217-227
Ellen Yi-Luen Do and Mark D Gross
proceedings of Computer Aided Architectural Design Research In Asia(CAADRIA1997) National Chiao Tung University, Hsinchu, Taiwan April 1997 pp 217-227
1997
Collaboration and Coordination in Architectural Design: approaches to computer mediated work
- pdf
Mark D Gross, Ellen Yi-Luen Do, Raymond J. McCall, Wayne V. Citrin, Paul Hamill, Adrienne Warmack, Kyle S. Kuczun
TeamCAD First GVU/NIST Workshop on Collaborative Design, Atlanta, GA
Mark D Gross, Ellen Yi-Luen Do, Raymond J. McCall, Wayne V. Citrin, Paul Hamill, Adrienne Warmack, Kyle S. Kuczun
TeamCAD First GVU/NIST Workshop on Collaborative Design, Atlanta, GA
1997
Computability of Design Diagrams: an empirical study of diagram conventions in design
- pdf
Ellen Yi-Luen Do, Mark D Gross
CAAD Futures proceedings of CAAD Futures 1997 Conference, Munich, Germany August 4-6, 1997 pp171-176
Ellen Yi-Luen Do, Mark D Gross
CAAD Futures proceedings of CAAD Futures 1997 Conference, Munich, Germany August 4-6, 1997 pp171-176
1997
Thinking with Diagrams
- pdf
Ellen Yi-Luen Do
Mark D Gross
Thiking with Diagrams Interdisciplinary Workshop January 9-10, Portsmouth
Ellen Yi-Luen Do
Mark D Gross
Thiking with Diagrams Interdisciplinary Workshop January 9-10, Portsmouth
1997
Resolving archaeological site data with 3D computer modeling: The case of Ceren
- pdf
Jenniffer Lewin and Mark D Gross
Automation in Construction 6(4) 323-334
Jenniffer Lewin and Mark D Gross
Automation in Construction 6(4) 323-334
1997
Network Design: Tasks & Tools
- pdf
Kyle Kuczun and Mark D Gross
ACM Designing Interactive Systems presented at ACM Designing Interactive Systems (DIS '97) August 18-20, 1997, Amsterdam, The Netherlands
Kyle Kuczun and Mark D Gross
ACM Designing Interactive Systems presented at ACM Designing Interactive Systems (DIS '97) August 18-20, 1997, Amsterdam, The Netherlands
1997
Collaboration and Coordination in Architectural Design: approaches to computer mediated team work
- pdf
Mark D Gross, Ellen Yi-Luen Do, Ray McCall, Wayne Citrin, Paul Hamill, Adrienne Warmack, and Kyle Kuczun
TeamCAD presented in TeamCAD First GVU/NIST Workshop on Collaborative Design, Atlanta, May, 1997 and published in Automation in Construction Vol. 7 pp465-473
Mark D Gross, Ellen Yi-Luen Do, Ray McCall, Wayne Citrin, Paul Hamill, Adrienne Warmack, and Kyle Kuczun
TeamCAD presented in TeamCAD First GVU/NIST Workshop on Collaborative Design, Atlanta, May, 1997 and published in Automation in Construction Vol. 7 pp465-473
1996
Demonstrating the Electronic Cocktail Napkin: a paper-like interface for early design
- pdf
Mark D Gross and Ellen Yi-Luen Do
ACM Conference on Human Factors in Computing (CHI ‘96) Conference Companion, pp. 5-6.
Mark D Gross and Ellen Yi-Luen Do
ACM Conference on Human Factors in Computing (CHI ‘96) Conference Companion, pp. 5-6.
1996
The Right Tool at the Right Time: An Investigation of Freehand Drawing as an Interface to Knowledge based Design Systems
- pdf
Ellen Yi-Luen Do
ACADIA 'Design Computation: Collaboration, Reasoning, Pedagogy', proceedings of Association for Computer Aided Design in Architecture (ACADIA 1996), University of Arizona, Tuscon, AZ, USA pp191-199
Ellen Yi-Luen Do
ACADIA 'Design Computation: Collaboration, Reasoning, Pedagogy', proceedings of Association for Computer Aided Design in Architecture (ACADIA 1996), University of Arizona, Tuscon, AZ, USA pp191-199
1996
Resolving archaeological site data with 3D computer modeling: Thecase of Ceren
- pdf
Jenniffer Lewin and Mark D Gross
"Design Computation: Collaboration, Reasoning, Pedagogy"proceedings of ACADIA 1996 Tucson, AZ, USA pp 255-266
Jenniffer Lewin and Mark D Gross
"Design Computation: Collaboration, Reasoning, Pedagogy"proceedings of ACADIA 1996 Tucson, AZ, USA pp 255-266
1996
The Right Tool at the Right Time - PhD Dissertation Proposal
- pdf
Ellen Yi-Luen Do
Georgia Institute of Technology
Ellen Yi-Luen Do
Georgia Institute of Technology
1996
Drawing as a Means to Design Reasoning
- pdf
Ellen Yi-Luen Do, Mark D Gross
Artificial Intelligence in Design (AID) ‘96 Workshop on Visual Representation, Reasoning and Interaction in Design, Palo Alto, CA.
Ellen Yi-Luen Do, Mark D Gross
Artificial Intelligence in Design (AID) ‘96 Workshop on Visual Representation, Reasoning and Interaction in Design, Palo Alto, CA.
1996
Ambiguous Intentions: A paper-like interface for creative design
- pdf
Mark D Gross and Ellen Yi-Luen Do
proceedings of 9th Annual Symposium for User Interface Software and Technology (UIST 1996) Seattle, WA, USA -November 6-8, 1996 pp 183-192
Mark D Gross and Ellen Yi-Luen Do
proceedings of 9th Annual Symposium for User Interface Software and Technology (UIST 1996) Seattle, WA, USA -November 6-8, 1996 pp 183-192
1996
PDA based Graphical Interchange for Field Service and Repair Workers
Wayne V Citrin and Mark D Gross
Computers and Graphics 20(5):641-649.
Wayne V Citrin and Mark D Gross
Computers and Graphics 20(5):641-649.
1995
Drawing Analogies - Supporting Creative Architectural Design with Visual References
- pdf
Mark D Gross and Ellen Yi-Luen Do
Computational Model of Creative Design (HI' 95) 3rd International Conference, University of Sydney, AUSTRALIA, 1995 pp37-58
Mark D Gross and Ellen Yi-Luen Do
Computational Model of Creative Design (HI' 95) 3rd International Conference, University of Sydney, AUSTRALIA, 1995 pp37-58
1995
Diagram Query and Image Retrieval in Design
- pdf
Mark D Gross and Ellen Yi-Luen Do
ICIP proceedings of 2nd International Conference on Image Processing (ICIP 1995), Washington, D.C., USA, October 23-26, 1995, pp. 308-311
Mark D Gross and Ellen Yi-Luen Do
ICIP proceedings of 2nd International Conference on Image Processing (ICIP 1995), Washington, D.C., USA, October 23-26, 1995, pp. 308-311
1995
Shape Based Reminding as an aid to Creative Design
- pdf
Ellen Yi-Luen Do and Mark D Gross
CAAD Futures proceedings of CAAD Futures 1995 Conference, National University of Singapore, Singapore pp79-90
Ellen Yi-Luen Do and Mark D Gross
CAAD Futures proceedings of CAAD Futures 1995 Conference, National University of Singapore, Singapore pp79-90
1995
Finding visual references by sketching
- pdf
Ellen Yi-Luen Do and Mark D Gross
ACADIA 'Computing in Design: Enabling, Capturing and Sharing Ideas', proceedings of ACADIA 1995, National Conference, University of Washington, Seattle, WA, USA pp35-52
Ellen Yi-Luen Do and Mark D Gross
ACADIA 'Computing in Design: Enabling, Capturing and Sharing Ideas', proceedings of ACADIA 1995, National Conference, University of Washington, Seattle, WA, USA pp35-52
1994
Recognizing and Interpreting Diagrams in Design
- pdf
Mark D Gross
Advanced Visual Interfaces in "Recognizing and Interpreting Diagrams in Design" Gross, M.D. In T. Catarci. M. Costabile, S. Levialdi, G. Santucci eds., Advanced Visual Interfaces '94 (AVI '94), ACM Press.
Mark D Gross
Advanced Visual Interfaces in "Recognizing and Interpreting Diagrams in Design" Gross, M.D. In T. Catarci. M. Costabile, S. Levialdi, G. Santucci eds., Advanced Visual Interfaces '94 (AVI '94), ACM Press.
1994
Stretch-A-Sketch, a dynamic diagrammer
- pdf
Mark D Gross
IEEE Symposium on Visual Languages (VL '94) Allen Ambler, ed., pp. 232-238
Mark D Gross
IEEE Symposium on Visual Languages (VL '94) Allen Ambler, ed., pp. 232-238
1994
Using diagrams to access a case library of architectural designs
- pdf
Mark D Gross, Craig Zimring, Ellen Yi-Luen Do
AID in J. Gero (ed), Artificial Intelligence in Design '94 (AID '94), pp 129-144, Kluwer.
Mark D Gross, Craig Zimring, Ellen Yi-Luen Do
AID in J. Gero (ed), Artificial Intelligence in Design '94 (AID '94), pp 129-144, Kluwer.
1994
The Cocktail Napkin, the Fat Pencil, and the Slide Library
- pdf
Mark D Gross
ACADIA "The Cocktail Napkin, the Fat Pencil, and the Slide Library" Gross, M.D. Proceedings, Association for Computer Aided Design in Architecture (ACADIA '94), pp 103-113, 1994 National Conference, St Louis.
Mark D Gross
ACADIA "The Cocktail Napkin, the Fat Pencil, and the Slide Library" Gross, M.D. Proceedings, Association for Computer Aided Design in Architecture (ACADIA '94), pp 103-113, 1994 National Conference, St Louis.
1992
Graphical Constraints in CoDraw
- pdf
Mark D Gross
Proceedings of IEEE Workshop on Visual Languages Seattle, WA pp 81-87
Mark D Gross
Proceedings of IEEE Workshop on Visual Languages Seattle, WA pp 81-87
1991
Grids in Design and CAD
- pdf
Mark D Gross
Proceedings of Association for Computer Aided Design in Architecture Los Angeles, CA
Mark D Gross
Proceedings of Association for Computer Aided Design in Architecture Los Angeles, CA
