Computational Augmentation Learning
from Artifical Intelligence
The Journey to Final Design
Think Design Render Render Think Design
What if we
the design process
what
we
the formula
The
if” Question? Challenging the tradition Statement 1 My design process always starts with sketching out ideas previous interest in sketching 3d sketching 3d vision = What if we start with rendering images? MidjourneyTrend?? Online beta that generates images using textual prompts 8/31/2022 Initial sketches to final Render What if we start with rendering images using AI How to render before thinking about design parameters??
reconsider
in architecture. Instead of “design follows process”,
if
use
of “Process follows design”
“What
How can I use AI in Architecture? 01
Conceptual Final Renders
BIM, Parametric
What is AI ?
Digital Models? Midjourney
AI programming focuses on three cognitive skills:
1.learning Process: This aspect of AI programming focuses on acquiring data and creating rules for how to turn the data into actionable information
2.Reasoning: This aspect of AI programming focuses on choosing the right algorithm to reach the desired outcome.
3.self correction: aspect of AI programming is designed to continually fine-tune algorithms and ensure they provide the most accurate results possible.
Similar to Architecture Design Process
Studying the project Site Analysis Requirements
Choosing the right method to design Revision
Approach New Approach
Traditional
Plan to Render Images Render to Plans
AI Images- Mid-Journey
The trend: What is Mid-Journey?? Mid-journey is an online beta that generate images using textual prompts You type, and you get the output as an image
your imagination take a form in few minutes How does it works???
1: Connect to discord to access
free online text
Step 2: Join any of the channels and start creating Step 3: Start writing what you want to see in an image by typing “/imagine” An airplane house by Zaha hadid and Frank Llyod Wright in a thunderstorm My first prompt Results Key Points/ Take away: 1. Need a textual promptdescribe your building with words 2. Specify the environmnet 3. A style specification using known artists How can I use AI in Architecture?
Seeing
Step
midjourney. (Discord is a
and voice chat service that allows hundreds or even thousands of users to come together and talk)
AI in Architecture
Language and Architecture Design Process
-How to represent an idea through images -Conceptual idea development -Final design comparison to different methods -Client/user input
Step 1: Study the evolution of design process over the years, and how famous architects work
Step 2: Study different methods of design process
Step 3: Define a new design pro cess, how is it different from the old or something done in past
Step 4: Impliment it in a program, a design proposal.
During the process: How AI works? how can you frame a design process around AI.
Study People’s Opinions
02
Dividing line between human and non-human
-Words to describe a building -images representing words -a common platform of understanding
-Kahn’s approach to design-a poetic manner -Image acts as a common medium to express multiple languages
Cultural difference in language?
AI does not justify language differences
The ability to describe it better in my regional language
Language & Architecture is a vast and whole different topic to be explored -deviavting from the main topic of AI in architecture May be not in this thesis
9/16/2022
At which stage in design process can AI be intergrated?
Architecture
Stages of Architecture Design Process: Pre- design Schematic Design Design developement Construction drawings Construction Conceptual ideas Sketching Models Images Diagrams Site Analysis study of other constraints Design Process: A problem solving approach Inspiration Identification Conceptulization Exploration Communication AI in Early design phase of Architecture A stage that is open to exploration and allow a designer to brainstorm What’s wrong with the traditional pre-design process? 03
Design Process
Traditional Pre-design Phase
Rough Sketching Abstract Paintings/ Models
Frank Gehry’s initial sketch for Disney Concert Hall Zaha Hadid’s initial paintings for inspiration of a project Rem Koolhaas’s Models for Seattle Public Library
Deconstructive and contempory architect’s use methods in pre design phase that is too abstract to be understood by non- designers
A switch to images
Something everyone can understand
Common platform of communication
Limitations of traditional early design phase
Narratives
Louis Kahn’s Writing of a Brick
Complex architecture writings Architects Vocab
1.Difficult to be under stood by non-designers.
2.Time consuming (model making)
3.Difficult to repre sent some ideas through sketches
4.Does not adapt to the changing technologi cal world of today
5.Need to know how to sketch and draw ideas
In my thesis, I would like to explore how computational adaptation in the early architectural design process can provide a diverse platform of inspiration and imagination to contemporary architects that can be easy to visualize
Statement 2
AI contribution in Architecture
How did AI get involved in Architecture? 04
Past AI involvement in Architecture
The Embroynic House: 1997- 2001 Greg Lynn
The Fold Theory: 1993 Greg Lynn
Frank Gehry: Use of CATIA 1993
Frank Gehry- Use of CATIA, an aerospace software to generate building model of Guggenheim Museum Bilbao
Use of computation more in design development phase BIM, AUTOCAD
Paperless Studio 1990’s
First digital age- introduction of blob in 1990’s
What is GAN ?
MIT Media Lab: Computer Aided Synthesis
Using StyleGAN2
Generated relatively realistic images of automobiles that don’t actually exist after being trained on a substantial dataset of cars.
Contribution
BIM Technology helps to translate 2D drawings into 3D models which help during the construction process to point out any failure in the design
Parametric Architecture allow designers to challenge the form
Provides a vision to the clients
Keeps the field of architecture active to the changing technological world needs.
Prof Curtis Roth- Use of computation to analyse design process, OSU
More devlopment of computer system in architecture
2019- Stanislas Chaillou Harvard thesis- Initiated to generate floor plans using AI
16th Century Shift Text to Printed images William Talbot First Architectural Photography 1830’s Paul Otlet City of Knowledge “Mundameum” 1910 1992 Paperless Studio Columbia Stanislas Chaillou 2019 Harvard Thesis Use of GAN to make floor plans Bernard Tschumi Stan Allen Hani Rashid Feb 5,2020 Style GAN2 2018,Dec Style GAN by NVDIA Discriminator Generator Real Fake Real Data GAN Ian Goodfellow 2014 April,2022 DALL.E- 2 Frank Gehry
Digital
Archaeology of Digital Shoei Yoh Peter Eisenman Chuck Hoberman digital tools used for form finding and roof development Odawara & Galaxy Toyama gymnasium 1990 and 1992 Biozentrum project 1987 Concept development using dig ital hybrid between digital and hybrid Lewis House 1989-1995 Digital used to create 3d model using CATIA Iris Dome Project 1988- 1994 Digital to create a structural component
History of
in Architecture
Timeline of Images in Architecture
First digital age- introduction of blob in 1990’s
The Embroynic House:1997- 2001
Digital mass customization phase in 1990 Greg Lynn
Converting a sketch into 3d model to start construction process
AI has been in the industry since a long time unknowingly. But most of the algorithms have been more invloved in design devlopment, rather than concept imagination.
Frank Gehry Disney concert hall
The Second Digital turn
can AI involvement in early design phase cotribute?? 05
of AI in
design
How
Use
early
stage
The Process of Thinking?? Problem Past Study/ Precedent Own Approach Design What if?? we can combine precedent study and imagination into one?? Have a thought?? A data center and Trampoline park in one space?? Hard to imagine?? Put text in Let AI think Ai combines past under standing of two places and create one Does the precedent study for humans Designers curate and design from their understanding
AI Oriented Design Process
Pre-Design
Begin to start thinking about the concept
Advantages of AI
AI Generations
Transform concept to textual prompt
Design Analyze the images generated by AI
Construct Make it happen
1. Allows wider imagination
2. Encourages iterative study
3. Gives a different perspective to the design
4. Images act as a common platform of communication with non-designers
06
Who decides the words to be used in the textual prompt of Mid-journey? Me or someone else?
Me?
User?
People who will be occupying and site analysis the space
Based on the project
Who are users??
- Users are a group of people who shall be inhabiting the building space after its fully constructed
-Users are different from clients -Clients can be users, but not every user is a client.
Try to take an adavange of the users by knowing their thoughts and vision of the building design
AI
Statement
In my thesis, I would like to explore how computational adaptation in the early architectural design process can provide a platform of collaboration with users How can we involve users in early design process? 07 Observation Interview Survey Method AI Interaction How can auidence interaction in early design phase help in architecture? 08 1. A base for Design Inspirataion 2. Provides new perspective 3. Ability to know non-designer trends 4. User Satisfaction 5. Material Challenge- Allows to know material palette of non-designer
User Oriented
Design Process
3
Mid-Review: User Experimentation
- Objective: To understand the choice of words by users to describe an architecture space that can affect AI generated images
- Method: Creating a Survey Poll by asking the users of Virginia Tech Acrhitecture library (located in Cowgill) to describe the space thorugh one word.
- Action: Applying those words as a textual prompt to generate Ai Images using multiple platforms.
Define
Silence Chairs Small Quite Transparent Making Not Private Entry view is nice Compartmentalized Overwhelming Jumbo Desks More Open Light Feel
Step 1: Collection of Data/ Survey
your architecture library experience in a word:
Step 2: Reference Image NEW: We can now add a reference image in AI platform to generate variations, with textual prompt
More rooms needed
Architecture Library, Cowgill
Text- to- Image (No Reference Image used)
Mid-Journey
Dalle-2 Stable Diffusion
Prompt: Architecture Library with an entrance window and central Skylight
Observation- Does not read the skylight and window as a seperate ob ject. Difficulty to define multiple elements. Blends in a wierd way
Prompt: Architecture Library with an entrance window and central Skylight with semi-enclosed rooms at mezzanine
The image on the left show a good depiction of the textual prompt than midjourney. It also added books on the mezzanine level without mentioning
Image- to- Image (Only Reference Image no words)
Mid-Journey Dalle-2
Unfortunately, Mid-Journey does not create variations of pro vided image without text
Added
Image- to- Image (Only Reference Image and words)
Prompt: Architecture Library with an entrance window and central Skylight with semi-enclosed rooms at mezzanine
Missing Mezzanine level. A more modern approach to design for a library. Added a person without me mentioning in the prompt.
Prompt: Architecture Library with an entrance window and central Skylight with semi-enclosed rooms at mezzanine
Does not even look close to the reference image provided.
Does not understand skylight, as it shows celestory windows Tried to pick colors in the image on the left
Prompt: Architecture Library with an entrance window and central Skylight with semi-enclosed rooms at mezzanine
Does not read skylight, there is no central space.
Image on the right looks similar to the mid-journey generation
Stable Diffusion
Unfortunately, Stable Diffusion does not create variations of pro vided image without text
Prompt: Architecture Library with an entrance window and central Skylight with semi-enclosed rooms at mezzanine
Very modern approach. Does not look like a library, but a house.
Picked up colors ( white, orange) Still no reading of skylights or mezzanine level
a door at the curtain wall, changed the ceiling lights. Moved the placement of desks. Looks more like an office
All Ai platforms have a parameter called “SEED” that represents the close proximity to the orginal image
Other
Mid-journey Parameters
Mid-journey parameters and command prompts 1. width: --w (setting up the width size of the output image) 2. Aspect Ratio: --ar (Width and height dimensions for the output image) 3. Uplight: --uplight (Blurs the image, less details) 4. High Defination: --HD (more style, less realistic) 5. Image weight: --iw (closeness to the reference image provided) 6. Sameseed: --sameseed (closeness to components of orginal image) 7. Style: --s (The style of mid-journey image renders), 625- less the number, less the style, more the number, more imaginative 60,000 8. Chaos: range: 0-100 ( more abstract with bigger number) --chaos 9. Negative: something you do not want in the image specificly --no (i.e: --no red) 10. Quality: --q (more details provided) range: 0-5 11. video: --video (creates a gif) 12. Title: --tile (creates patterns similar to tiles) (It can read architecture rendering style, such as V-Ray, Octane Render, etc)
09
Understanding why any of the results did not create a close representation of the reference image
Mid-Review Questions and Comments
A Turnover
Comments:
1. The user approach is very limited. It does not study the physical behavior of the users while selecting the words. Study the gestures and movements.
2. Define the process in detail. How will AI play a crucial role in it?
3. Study the biases of choosing. How do users select?
4. More of user-based approach than artifical intelligence. What if you allow the users to have hands on with the artifical intellgence.
Take Aways and Ideas:
What if I take the idea of reference image a step further by creating my own reference image? SKetches- Models- Paintings
AI is eventually all over the world today. Artificial intelligent images are able to convey new architectural designs through the use of words. However, in the process of developing from scratch, designers end up creating a common style of architecture. This style starts to diverge from originality. Through my thesis, I want to enhance my past design proposal using a collaborative approach with the architectural design process and Artificial intelligence. This method integrated with the architecture dictionary will allow an open interpretation of an image.
A collobration with the traditional pre-design process, rather than proving them out-dated.
Image-to-Image Focused
4
Statement 4
Image to Image: Stable Diffusion Sketches
An experiment to try my sketches as a reference image on artifical intelligent platform, ,mainly Stable Diffusion
Result Analysis
Changing the image strength everytime with same prompt gave amazing results
Stable diffusion gave more artistic and abstract designs compared to past studies with mid-journey.
Image-to-Image is a powerful tool, and allows to have a control over the design
An Architecture building Image strength- 70
An Architecture building in NYC Image strength- 70
A contemporary modern architecture building made of trees and mountains
A contemporary modern architecture building made of trees and mountains IS- 40
A contemporary modern architecture library with chairs made of tree barks and people reading books
A contemporary modern architecture library with chairs made of tree barks and people reading books
Image to Image: Stable Diffusion Models
Realistic Architecture building Image Strength- 80
Realistic Architecture building Image Strength- 70
Realistic Architecture building Image Strength- 30
Realistic Architecture building Image Strength- 50
Realistic Architecture building Image Strength- 40
Refined Thesis- Collobrating traditional design process, such as sketching, modeling, renders with artifical intelligence to provide a new perspective for designers to think
