Home Conference Sessions Practical Gen AI...

Practical Gen AI: Building a Chatbot using Spring AI

Rod Johnson | YOW! Brisbane 2024

You need to be signed in to add a collection

In this code-driven talk using Kotlin, Spring Boot and htmx, Rod will show just how good the JVM is as a platform for building Gen AI applications. He'll show how to use Spring AI to build a chatbot with personality, covering: - RAG (Retrieval Augmented Generation) using a VectorStore - Why and how to mix different LLMs, including open source LLMs running locally, in the same application - How the Spring AI ""advisor"" architecture can be used to create clean, reusable components - How to add a toxicity guard and other crosscutting functionality - How and why to exchange structured data with LLMs - Best practices for building Gen AI applications He'll share his code on GitHub so attendees can continue their own exploration.

Share on:
linkedin facebook
Copied!

Transcript

In this code-driven talk using Kotlin, Spring Boot and htmx, Rod will show just how good the JVM is as a platform for building Gen AI applications.

He'll show how to use Spring AI to build a chatbot with personality, covering:

  • RAG (Retrieval Augmented Generation) using a VectorStore
  • Why and how to mix different LLMs, including open source LLMs running locally, in the same application
  • How the Spring AI ""advisor"" architecture can be used to create clean, reusable components
  • How to add a toxicity guard and other crosscutting functionality
  • How and why to exchange structured data with LLMs
  • Best practices for building Gen AI applications

He'll share his code on GitHub so attendees can continue their own exploration.

About the speakers

Rod Johnson

Rod Johnson

Creator of Spring and Co-founder and CEO at Atomist