Digital Twin Model from Freehanded Sketch to Facade Design, 2D-3D Conversion for Volume Design

The article proposes a method for creating digital twins from freehand sketches for facade design, converting 2D designs to 3D volumes, and integrating these designs into real-world GIS systems. It outlines a process that involves generating 2D exterior images from sketches using generative AI (Gemini 1.5 Pro), converting these 2D images into 3D models with TriPo, and creating design drawings with SketchUp. Additionally, it describes a method for creating 3D exterior images using GauGAN, all for the purpose of construction exterior evaluation. The paper also discusses generating BIM data using generative AI, converting BIM data (in IFC file format) to GeoTiff, and displaying this information in GIS using QGIS software. Moreover, it suggests a method for generating digital twins with SketchUp to facilitate digital design information sharing and simulation within a virtual space. Lastly, it advocates for a cost-effective AI system designed for small and medium-sized construction companies, which often struggle to adopt BIM, to harness the advantages of digital twins.

@article{Arai2025,
  title     = {Digital Twin Model from Freehanded Sketch to Facade Design, 2D-3D Conversion for Volume Design},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {16},
  number    = {1},
  year      = {2025},
  publisher = {The Science and Information Organization},
  author    = {Kohei Arai},
  doi       = {10.14569/IJACSA.2025.0160109},
  url       = {https://doi.org/10.14569/IJACSA.2025.0160109}
}