039: GPT 4o Use Cases: Store & Plant ID

In partnership with

Welcome to this week’s edition of the Architecture Insights newsletter. Artificial intelligence for architects, landscape architects, and designers.

Edition #39:

  • AE Studio: Creating your own AI product for your firm

  • Apple AI Announcements: WWDC conference

  • GPT Store: How to access it as an architect or landscape architect

  • GPT4o Plant ID: Using ChatGPT to identify plants


Have an AI Idea and need help building it?

When you know AI should be part of your business but aren’t sure how to implement your concept, talk to AE Studio.

Elite software creators collaborate with you to turn any AI/ML idea into a reality–from NLP and custom chatbots to automated reports and beyond.

AE Studio has worked with early stage startups and Fortune 500 companies, and we’re ready to partner with your team. Computer vision, blockchain, e2e product development, you name it, we want to hear about it.

Apple AI Upgrades

At the 2024 Worldwide Developers Conference (WWDC), Apple unveiled significant advancements in artificial intelligence (AI) under the banner of "Apple Intelligence." Key updates include a major overhaul of Siri, which now integrates with OpenAI's ChatGPT, allowing for more natural interactions and real-time corrections via text.

Apple emphasized its commitment to privacy, ensuring most AI features run on-device, with complex tasks handled by M2 Ultra-based servers.

Apple's AI strategy focuses on practical, device-centric features. For instance, iOS 18 and iPadOS 18 will include AI-driven enhancements such as improved on-device Spotlight searches, AI-powered transcriptions in the Voice Memo app, and more natural-sounding Siri interactions.

Additionally, VisionOS 2 introduces Spatial Photos, transforming 2D images into immersive experiences, and new hand motion gestures for easier navigation.

For architects and landscape architects, these AI updates could be particularly beneficial. The enhanced AI-driven search capabilities and transcriptions can streamline project documentation and communication.

Moreover, the VisionOS 2's ability to create Spatial Photos from 2D images can provide a more immersive way to present and visualize design concepts, offering clients a richer, more interactive experience.

GPT Store

The GPT Store offers architects and landscape architects a powerful platform to enhance their design processes and workflows. This platform allows users to discover and utilize customized versions of ChatGPT tailored to specific needs, making it an invaluable tool for professionals in the architecture and landscape design fields. Since the release of GPT4o, it is free for all users.

How to Use the GPT Store as an Architect or Landscape Architect

1. Exploring Design Tools:

Architects can browse the GPT Store to find AI tools that assist in various stages of the design process. For instance, tools like DALL·E can generate high-quality images and visualizations, while other GPTs can help create detailed site analyses and feasibility studies. These tools can save significant time and resources by automating tasks that traditionally require manual effort[3][5].

2. Generating Design Ideas:

By using GPTs designed for ideation, architects can quickly generate a plethora of design concepts. For example, a GPT can provide innovative strategies for optimizing natural lighting and ventilation in urban residential projects, or suggest landscape design methods to enhance land value and community engagement.

3. Creating and Refining Prompts:

The GPT Store includes tools that help architects craft precise and effective prompts. This is crucial for obtaining targeted and relevant responses from AI. For example, a prompt might include context about a project, specific design challenges, and any constraints, ensuring the AI provides useful and actionable insights[4].

4. Combining AI Tools:

Architects can combine ChatGPT with other AI tools to enhance their workflow. For instance, using ChatGPT to generate architectural prompts for Midjourney can streamline the creation of visual content, while integrating image analysis capabilities can provide deeper insights into site conditions and design opportunities.

5. Customizing GPTs:

The GPT Store allows architects to create and share custom GPTs tailored to their specific needs. This can include tools for project management, client presentations, or even plant identification for landscape projects. Custom GPTs can be saved and reused.

Plant ID with GPT4o

To use GPT-4o for plant identification, a landscape architect might follow a process. Here is a description of the steps involved:

- Begin by selecting the site for analysis. This could be an urban park, a residential garden, or any other landscape project.

- Using a phone camera or a drone, capture high-quality images of the plants and the overall site. These images should be clear and cover various angles to ensure comprehensive identification.

- Access the GPT-4o interface, which can be done through a mobile app or a web platform.

- The images captured are uploaded to the GPT-4o system. This can be done by clicking the camera icon within the app and selecting the images to be analyzed.

- Ask GPT-4o to identify the plants in the uploaded images. GPT-4o processes the images and identifies multiple plants within a single image, providing detailed information about each plant, including their names and characteristics.

- Review the identification results provided by GPT-4o. This includes checking the accuracy of the plant names and the additional information provided, such as care instructions and habitat details.

- Beyond plant identification, you can use GPT-4o to analyze the site conditions. For example, they can upload aerial photos and ask GPT-4o to identify the types of buildings and other features present in the area.

- Using the identified plants and site analysis, the architect can integrate this information into their design plans. GPT-4o can suggest suitable plant species based on specific criteria such as climate, soil type, and maintenance requirements, ensuring the chosen flora is well-adapted to the local environment.

AI Image of the week

Thank you for reading this week’s issue, check past issues here. Share this newsletter with colleagues, friends, or anyone interested in the combined world of architecture and artificial intelligence.

Did you enjoy this week's post?

Login or Subscribe to participate in polls.