Feeding ML models with the data from the databases in real-time https://peertube.watch/videos/watch/3315a62f-74d1-4525-bec8-5dca3f6c5828 In today's fast-paced business environment, and especially with the advent of machine learning (ML), organizations are seeking ways to derive better insights from their data as quickly as possible. However, implementing a complete ML pipeline can be quite challenging. It’s even harder if you want to process newly arrived data immediately or you have a legacy system which is not easy to connect with your modern infrastructure . Change Data Capture (CDC) has emerged as a technology for delivering real-time data changes from various sources, especially from the databases. In this talk we will introduce Debezium, a leading open source framework for CDC. We will discuss how it can be leveraged for ingesting data from the various databases into ML frameworks like TensorFlow and what the pitfalls are if you go this route. Attendees will gain an understanding of how Debezium CDC works, how it can help them to ingest data from the source database into the ML framework in real time and also what are the possible challenges with this approach. Speaker: Vojtech Juranek, Track: HPC, Big Data & Data Science devroom, Room: UA2.118 (Henriot), When: Saturday 3 February 2024, 14:00–14:10 (Brussels time), Schedule: FOSDEM 2024 event page, Slides & links Presentation slides, Debezium project, Image classification with Debezium and TensorFlow blog post, Debezium ML examples source code, Licence: Creative Commons Attribution 2.0 Belgium (CC BY 2.0 BE) (as stated in the FOSDEM video archive). Attribution: “Feeding ML models with the data from the databases in real-time” by Vojtech Juranek, FOSDEM 2024. Original recording: 2024/ua2118/fosdem-2024-2272-feeding-ml-models-with-the-data-from-the-databases-in-real-time.av1.webm from the FOSDEM video archive. This channel is an unofficial mirror; FOSDEM is a free and non-commercial event organised by the community for the community. Tue, 20 Oct 2026 22:17:47 GMT https://validator.w3.org/feed/docs/rss2.html PeerTube - https://peertube.watch Feeding ML models with the data from the databases in real-time https://peertube.watch/lazy-static/avatars/3b284627-b75f-409e-ac2e-10f4c2946f43.png https://peertube.watch/videos/watch/3315a62f-74d1-4525-bec8-5dca3f6c5828 All rights reserved, unless otherwise specified in the terms specified at https://peertube.watch/about and potential licenses granted by each content's rightholder.