How Small AEC Firms Can OUTPACE Giants in Tech!

Key Concepts

AI, Innovation, AEC Industry, Small Business Challenges, Technology Adoption, Internal Innovation Working Group, RAG AI, Commercial Off-the-Shelf (COTS) Technology, Return on Investment (ROI), Building Envelope, Roof Surveys, Proposal Generation, Password Management, Executive Champion, Build vs. Buy, Cyber Security, LLM (Large Language Model), Gemini, Chat GPT, Llama 3, Revit, Specification Writing, Data Collection, SAS (Software as a Service).

Main Topics and Key Points

Introduction and Background

• Mike Ramos, President of Raymond, discusses how a small firm can become a technology leader in the AEC industry.
• Raymond is a full-service architecture and engineering firm specializing in building envelope.
• Mike's background is in chemical engineering and management consulting, with experience in prototyping technology solutions.
• He joined Raymond full-time in 2017 and became president after serving as executive vice president.

Spark for AI and Innovation

• Mike was surprised by the lack of technology in roof surveys when he joined Raymond.
• He envisioned using technology and AI to improve processes, aiming for a "Tony Stark/Jarvis" type of design workflow.
• The release of Chat GPT validated his vision, which was initially met with skepticism.

Challenges Faced by Small Businesses

• Limited resources and lower margins in the AEC industry compared to tech companies.
• Difficulty in investing in technology development.
• Password management issues among employees hindered initial app adoption.

Internal Innovation Working Group

• Modeled after internal research and development projects at Booz Allen Hamilton.
• Started to encourage employees to experiment with AI and technology.
• Meets bi-weekly for 30 minutes, with a focus on trying new things and reporting back.
• Participation is voluntary to foster passion and initiative.
• The group has influenced proposal development and identified useful AI tools.

Translating AI Concepts into Practical Use Cases

• Focus on writing-related tasks, such as proposals and responses to requests for qualifications (RFQs).
• Using AI to draft proposals, research assumptions, and generate initial drafts for building envelope commissioning.
• Automating the process of responding to public sector RFQs by using AI to generate resumes and project pages.

RAG AI Implementation

• Raymond has implemented a Retrieval Augmented Generation (RAG) AI behind their firewall.
• Uses open-source AI (Llama 3) and their own GPUs.
• The AI learns from their project server to generate resumes, project pages, and answer technical questions.
• Generates resumes in Word format.

Measuring Success and Value of Innovation

• Testing AI-driven processes against traditional methods to quantify time savings.
• Example: AI-powered price proposal generator saved 6-8 hours of project manager and discipline director time on two proposals.
• Emphasizes the need for "chaperone AI" – human oversight and proofing of AI-generated content.

Overcoming Setbacks

• Initial thesis for specification writing software using AI to read Revit files showed good results for architecture but failed for engineering.
• The team pivoted to a new data collection method to eventually train the AI.

Commercialization of Software

• Raymond plans to commercialize its specification software by the end of May.
• Offers Quantum, a free-to-use software platform, with plans to monetize advanced AI features later.
• Believes in generating new revenue streams by commercializing internal tools.

Positioning as a Technology Leader

• Becoming more knowledgeable than others in the industry.
• Focusing on a specific niche within AEC and AI.
• Starting an innovation working group to experiment and empower employees.
• Trying out various AI tools and platforms, even if they have limited free trials.
• Leveraging the agility of a small business to adapt and change quickly.

Final Advice

• Keep an open mind and recognize that you don't have to come up with all the ideas.
• Build a team of passionate individuals to explore and experiment with AI.
• Network with others in the industry and bounce ideas off of them.
• Start conversations and be open to trying new things, even if they don't work out.

Important Examples, Case Studies, or Real-World Applications Discussed

• Roof Survey Project: Mike's initial experience highlighted the lack of technology in basic tasks like roof surveys.
• Price Proposal Generator: Demonstrated a significant time saving (6-8 hours) compared to traditional methods.
• Specification Writing Software: Initial success with architecture led to challenges with engineering, prompting a pivot in approach.
• RAG AI for Resume Generation: Automating the creation of resumes and project pages for RFQ responses.

Step-by-Step Processes, Methodologies, or Frameworks Explained

• Implementing an Internal Innovation Working Group:
  1. Establish a regular meeting schedule (e.g., bi-weekly for 30 minutes).
  2. Encourage voluntary participation to foster passion.
  3. Provide a small budget for experimentation.
  4. Encourage employees to try new things and report back on their findings.
  5. Share results and insights across the organization.
• Measuring ROI of AI Implementation:
  1. Identify a specific task or process to improve.
  2. Run the task using both the traditional method and the AI-powered method.
  3. Measure the time, cost, and quality of the results for each method.
  4. Compare the results to determine the ROI of the AI implementation.
• Implementing RAG AI:
  1. Choose an open-source LLM (e.g., Llama 3).
  2. Acquire necessary hardware (GPUs).
  3. Set up the AI behind a firewall for security.
  4. Train the AI on internal data (e.g., project server).
  5. Integrate the AI into existing workflows (e.g., resume generation).

Key Arguments or Perspectives Presented, with Their Supporting Evidence

• Small businesses can be technology leaders: Despite limited resources, small businesses can leverage their agility, focus on specific niches, and empower employees to experiment with technology.
• AI is not just for large firms: Small businesses can benefit from AI by focusing on practical use cases, such as writing proposals and automating repetitive tasks.
• Experimentation and learning are crucial: It's important to try new things, even if they don't work out, as this provides valuable insights and helps identify opportunities for improvement.
• Human oversight is essential: AI should be used as a tool to augment human capabilities, not replace them entirely.

Notable Quotes or Significant Statements with Proper Attribution

• Mike Ramos: "Why aren't we aiming for us being Tony Stark the designer working with Jarvis?"
• Mike Ramos: "Don't be embarrassed if you haven't tried [AI]. A lot of companies are still trying to figure out what AI is, and that's okay."
• Mike Ramos: "You need a chaperone AI."

Technical Terms, Concepts, or Specialized Vocabulary with Brief Explanations

• AI (Artificial Intelligence): The simulation of human intelligence in machines that are programmed to think like humans and mimic their actions.
• AEC (Architecture, Engineering, Construction): The industry encompassing the design, planning, and construction of buildings and infrastructure.
• RAG AI (Retrieval Augmented Generation AI): An AI architecture that combines a pre-trained language model with a retrieval mechanism to generate more accurate and context-aware responses.
• COTS (Commercial Off-the-Shelf): Software or hardware products that are ready-made and available for purchase by the general public.
• ROI (Return on Investment): A performance measure used to evaluate the efficiency of an investment or compare the efficiency of a number of different investments.
• Building Envelope: The physical separator between the interior and exterior environments of a building.
• LLM (Large Language Model): A type of AI model that is trained on a massive amount of text data to generate human-like text.
• GPU (Graphics Processing Unit): A specialized electronic circuit designed to rapidly manipulate and alter memory to accelerate the creation of images in a frame buffer intended for output to a display device.
• SAS (Software as a Service): A software distribution model in which a third-party provider hosts applications and makes them available to customers over the Internet.
• Revit: A BIM (Building Information Modeling) software used for architectural design, structural engineering, MEP engineering, and construction.
• Llama 3: An open-source large language model developed by Meta.

Logical Connections Between Different Sections and Ideas

• The initial challenge of outdated roof survey processes led to the exploration of AI and technology solutions.
• The limitations of being a small business prompted the creation of an internal innovation working group to leverage employee ideas.
• The success of the innovation working group led to the development of AI-powered tools for proposal generation and other tasks.
• The implementation of RAG AI behind the firewall was driven by the need for secure data processing for Department of Defense projects.
• The measurement of ROI helped validate the effectiveness of AI implementations and guide future development efforts.

Data, Research Findings, or Statistics Mentioned

• Margins in the AE industry typically approach 15-20% net income.
• Raymond responds to approximately 400 RFQs per year.
• The AI-powered price proposal generator saved 6-8 hours of project manager and discipline director time on two proposals.
• Specification writing software achieved 90+% fidelity in generating table of contents for architecture discipline.

Synthesis/Conclusion of the Main Takeaways

Mike Ramos's discussion highlights that small businesses in the AEC industry can become technology leaders by embracing innovation, empowering employees, and focusing on practical AI applications. Overcoming challenges like limited resources requires a strategic approach that includes experimentation, collaboration, and a willingness to adapt. By measuring the ROI of AI implementations and sharing their experiences, small firms can drive industry-wide progress and gain a competitive advantage. The key is to start small, learn from failures, and build a culture of continuous improvement.