Skip to content
Matthias Bohlen

iSAQB® CPSA Advanced Level Workshop

Software Architecture for AI Systems

Design AI-based systems. A three-day intensive workshop with Matthias Bohlen (30 CP for iSAQB® CPSA-A).

days
3
credit points
30
people max.
12
language
DE / EN
Book your seat ↓

You know how to architect classic systems without AI? Good, because the world has changed. Systems now learn, adapt and evolve.

You want to stay relevant in your role? Then this is your new mission: become an architect of AI-based systems, and design for new stakeholders, new structures and new artefacts.

You bring all your experience and learn everything that's new. Not just software that works, but systems that think.

What to expect in the workshop

In this Advanced Level module you learn to build modern software architectures for AI systems: how you and your teams use well-thought-out architectures to build AI solutions that perform, scale and integrate well.

Working in a team on a realistic case study, you work out the key architecture principles for AI systems and apply them straight away to the design and later implementation of machine learning and generative AI systems. Back at work, you'll integrate AI components into existing software systems much more smoothly.

The training covers both "ordinary" machine learning systems and generative AI with LLMs, and shows you how to integrate AI into classic software systems. You learn how to shape such hybrid systems so they stay scalable, maintainable and extensible.

iSAQB accredited training

Accredited training for the iSAQB® Certified Professional for Software Architecture, Advanced Level (CPSA-A). It counts for 30 credit points (20 technical · 10 methodical).

Content

  1. 01

    Introductionthe software architecture concepts that matter for AI, including the vocabulary, possible use cases, risks, strengths and weaknesses, and when you're better off with AI or with classic software development.

  2. 02

    Compliance, security and alignmentthe legal and regulatory landscape of AI systems that software architects need to know, including EU AI Act compliance, data protection law and risk classification frameworks.

    Technical security strategies to protect AI systems against attacks, robust data management practices, and proper documentation for traceability and transparency.

    Ethical AI governance: safety principles, responsible AI frameworks, and how to build compliance, security and ethics into your architecture decisions.

  3. 03

    Understanding ML systemsthe basics of machine learning project lifecycles and software development processes for AI systems. Defining ML tasks, understanding the problem's requirements, and specifying the input and output data of ML systems.

  4. 04

    Exploratory data analysisdifferent data types and typical ML problems, and how data scientists acquire, label and analyse datasets. How to spot bias in data, and the storage options for ML projects.

  5. 05

    Data cleansing and preparationstrategies for data aggregation, cleansing, transformation and augmentation with modern data engineering tools. How data scientists design efficient data pipelines and handle the data quality problems that can hurt ML systems.

  6. 06

    Feature engineeringhow to prepare input data for different AI algorithms, and the trade-offs between model architectures. Advanced techniques such as transfer learning and fine-tuning to optimise model performance.

  7. 07

    Model training and model selectionthe hardware requirements for training models, and how to track model parameters, metrics and results. Model evaluation techniques that weigh cost, sustainability and reproducibility.

  8. 08

    Building a proof of conceptchoosing the right tools to prototype AI systems and applying design patterns for ML applications. User interface design principles and the explainability requirements of AI systems.

  9. 09

    Deploying ML systemsCI/CD pipelines, deployment strategies and platform options for ML models, including SaaS and self-hosted solutions. Integrating ML models into existing systems while keeping security, compliance and deployment architecture in mind.

  10. 10

    Operating ML systemsthe monitoring needs specific to AI systems, and measuring performance metrics such as latency and throughput. Strategies for scalability, robustness, reliability and fault tolerance in production ML systems.

  11. 11

    Maintaining ML systems over timespotting and handling the different kinds of model drift and ongoing data quality problems. Using user feedback to improve the model and keep the system performing over the long run.

  12. 12

    System architectures and platforms for generative AIhow to integrate AI systems, especially large language models (LLMs), into real IT architectures with practical tools, libraries and interfaces.

    The basics of generative AI and LLMs, together with techniques such as prompt engineering, retrieval-augmented generation (RAG) and agentic workflows, to build effective AI applications.

    The practical side too: system evaluation, cost management, quality assurance and design patterns for running AI solutions in production.

Who it's for

Software architects and developers who design or evolve systems with AI.

You should have experience in IT projects or product development. You don't need to know any particular technology to follow along and take part. Python helps; being able to at least read Python code is an advantage.

The course is a good fit if you already know architecture in principle and are curious what data science, machine learning and generative AI will change for you.

The course is probably not for you if you're already a data scientist or ML expert and don't know anything about software architecture yet. The AI topics will feel (too) familiar. In that case, take the CPSA-F course first.

Prerequisites

Experience in IT projects or product development. You don't need to know any particular technology to follow along and take part. Python helps: you should at least be able to read Python code.

You need a computer with a development environment that opens Jupyter notebooks and runs their code cells. It helps if you've installed the sample solution from the training material and got it running before the training.

What you already know

As a software architect, these have been your tasks so far, and they stay your tasks in the age of AI:

How AI changes your tasks now

An AI project is just another software project, isn't it? Well, there are a few differences.

You work for new stakeholders

  • Data scientists
  • Machine learning engineers
  • MLOps engineers
  • Ethicists
  • And more

You design two systems instead of one

  • One for training time
  • One for inference time

You get three artefacts instead of one

  • The code (as before)
  • The data (new)
  • The model (new)

You become a kind of Sherlock Holmes for data

Classic systems work once and for all, as long as nobody tinkers with them. If you break something, the tests fail. Or, if you have too few tests, at least the system crashes loudly and clearly.

AI systems change quietly, without crashing or breaking tests. They just deliver worse results. That asks for a different, more watchful mindset.

Training material

You get:

  • A realistic case study of an AI-based system
  • Six hands-on design exercises on the case study, which you work through in a small group of 3 to 4 people
  • A sample solution for another case study: raw data, cleaned data, trained model and code, all integrated into a working web application in Python and TypeScript, ready to deploy in Docker containers
  • A PDF of the slides from the training
  • My SWARC4AI book, more than 500 pages, as a PDF and as an EPUB for your e-reader

The material is always in the language the training is taught in.

Delivery

A balanced mix of talks and hands-on exercises. With my guidance, you learn in small groups how to design systems that contain AI.

You get a case study to work on, and you design an AI-based system for it.

Online

The training is also available online, with Zoom (or Microsoft Teams if need be) as the video platform. I've set up a fully equipped video studio with professional broadcast hardware for it.

Book your seat

In-house for your company? Call +49 170 772 8545 or email mbohlen@mbohlen.de.