Modern Web Podcast S12E37- Java’s AI Evolution: Semantic Caching JVM, and GenAI Architectures with Theresa Mamarella & Brian Sam-Bodden

In this episode of the Modern Web Podcast, Danny Thompson, Director of Technology at This Dot Labs, hosts a conversation with Theresa Mammarella, JVM engineer at IBM, and Brian Sam-Bodden, Applied AI Engineer at Redis. They explore their talks at JCONF in Dallas, Texas, covering topics like GenAI architectures in the Java community and OpenJDK's Project Valhalla. Their conversation covers Java’s evolution, AI applications, semantic caching, and how these technologies are impacting development workflows and performance optimization. Chapters 00:00 - Introduction   01:00 - Brian on GenAI in the Java Community   01:47 - Java’s Safe Evolution Path   02:17 - Teresa on Project Valhalla   03:54 - Value Classes and Performance   04:33 - Brian on Semantic Caching   06:54 - Challenges of Rewording Prompts   09:15 - What is RAG Architecture?   11:34 - Java’s Role in AI   13:57 - Cost of LLMs and Caching Strategies   15:57 - Teresa on Java’s Future   18:22 - Learning Resources for Java Developers   20:44 - Addressing Misconceptions About Java   22:39 - Final Thoughts   Follow Theresa Mammarella & Brian Sam on Social Media Theresa Mammarella Twitter: https://x.com/t_mammarella?lang=en Brian Sam-Bodden Twitter: https://x.com/bsbodden Theresa Mammarella Linkedin: https://www.linkedin.com/in/tmammarella/ Brian Sam-Bodden Linkedin:  https://www.linkedin.com/in/sambodden/