Dynamic Data Pipeline Tuning via Meta-Learning for Continual Adaptation in Evolving Data Streams
Abstract:
In dynamic environments, machine learning models must adapt to continuous changes in data—something traditional pipelines fail to handle. This keynote introduces ML-DPA (Meta-Learned Data Pipeline Adaptation), a novel framework that uses meta-learning to dynamically reconfigure data preprocessing and feature engineering in response to distribution shifts.
Unlike conventional approaches that focus solely on model updates, ML-DPA adjusts the pipeline itself—enabling real-time adaptation, reduced forgetting, and sustained performance in non-stationary data streams. The approach is validated across domains like autonomous vehicles, fraud detection, and health monitoring, with benchmarks showing faster recovery from drift and improved accuracy.
This session will explore the architecture, experimental results, and real-world applications of ML-DPA, offering a new perspective on building resilient, lifelong learning systems.
Profile:
Karan Alang is a Principal Software Engineer, Tech Lead, and Architect with 25 years of experience designing and scaling distributed systems, cloud-native platforms, and AI/ML solutions. Throughout his career, he has led innovation and engineering excellence at world-class organizations such as Apple, Versa Networks, 3M, Lenovo, and US Steel — driving impactful work in big data, real-time analytics, and intelligent automation.
He currently heads the Data Engineering team at Versa Networks Inc., where he architects scalable data pipelines and platforms that support advanced machine learning and security intelligence.
Beyond his technical contributions, he is deeply engaged with the global tech community. He is an IEEE Senior Member, ACM member, and a Member of the Forbes Technology Council, staying closely connected with emerging research and thought leadership in the field.
He is also an open-source contributor to the Apache Airflow community and actively supports innovation in data orchestration. In addition, he has served as a hackathon judge and technical speaker at multiple industry events.
You can send your queries to the following email ID:
WhatsApp Contact: +91-7692804154 (messages only)
© Copyright @ icivc2025. All Rights Reserved