I’ve started experimenting with the use of stable diffusion and LoRA models trained specifically with architectural renderings.

Just using the IFC CAD model, I was able to place some people and camers into the 3d scene and quickly render out a depth and line pass, while foregoing the need to add lighting, materials, shaders and post-processing.

This was then fed into a controlnet with text prompts to output the final renders. Tthe images speak for themselves, while not perfect, they communicate the exterior site effectively enough without too much uncanny valley.



Observations:

• It’s still difficult to control material finishes without a lot fo masking and manual prompting. Next time I’ll rendering out an object mask and see if I can control this and aim for more consistancy with finishes

• All rendering was done in a day, compared to roughly a week of work doing it manually/”the old fashioned way”
  

note: the artwork still needed to be rendered using a rendering/lighting system ​(fstorm) as surface finish and position was important to get precise