Mr. Linga Reddy Alva

From Big Data to Agentic Intelligence: Building Self-Optimizing AI Systems with Databricks Agent Framework

Abstract:

This keynote explores the shift from traditional data systems to Agentic AI, where autonomous, reasoning-driven agents collaborate with enterprise data platforms for continuous optimization and decision intelligence. Using the Databricks Agent Framework (Agent Bricks), we’ll discuss how organizations can build self-optimizing and adaptive AI systems powered by Delta Lake and Unity Catalog. Real-world use cases—such as intelligent data quality monitoring and generative AI assistants—illustrate how agentic systems transform analytics, governance, and automation. Attendees will learn strategies for designing scalable, trustworthy, and intelligent AI ecosystems that bridge the gap between data engineering and next-generation enterprise AI.

Profile:

Linga Reddy Alva is a Data & AI Solutions Architect and IEEE Senior Member specializing in cloud-native enterprise data engineering, real-time analytics, and advanced AI/ML integration. With over a decade of experience in designing and delivering large-scale data platforms across industries, he has deep expertise in Spark, Databricks, Kafka, and modern data lakehouse architectures. His work focuses on bridging data engineering with AI innovation, particularly in Generative AI, Agentic AI, and AI-driven automation for enterprise transformation. He has contributed extensively to the Databricks community, published technical articles, and served as a speaker and mentor in professional forums. Linga Reddy Alvahas a proven track record in architecting scalable and responsible AI systems that enhance decision-making, optimize operations, and unlock business value. He is passionate about advancing trustworthy AI practices and mentoring the next generation of data and AI professionals.