https://peertube.watch/videos/watch/1c8440ea-ab5a-45ad-b75d-123e29d74ef1 Efficiently migrating petabytes of object storage data between two production Ceph clusters posed a significant challenge with live data being written to both clusters, necessitating a seamless process to minimize disruptions. The migration strategy involved extracting user accounts, including access and secret keys, from the old cluster and seamlessly transferring them to the new one. The synchronization of buckets and live data has been improved by extending and enhancing powerful tools such as rclone, executed in parallel. This migration endeavor not only resulted in the successful transfer of vast amounts of data but also paved the way for the creation of a robust tool named Chorus. Chorus, specifically designed for synchronizing S3 data, emerged as a versatile solution capable of harmonizing data seamlessly across multiple cloud storage backends. This innovative tool is helpful in effective bridging of data between Ceph clusters, demonstrating the adaptability and scalability required for modern data management challenges. Key highlights of Chorus include persistence of migration, execution of migration on multiple machines, rate limiting RAM/network usage during migration. Speaker: Sirisha Guduru, Track: Software Defined Storage devroom, Room: K.3.201, When: Saturday 3 February 2024, 15:30–16:00 (Brussels time), Schedule: FOSDEM 2024 event page, Slides & links Presentation (slides), Licence: Creative Commons Attribution 2.0 Belgium (CC BY 2.0 BE) (as stated in the FOSDEM video archive). Attribution: “Chorus - Effortless Ceph S3 Petabyte Migration” by Sirisha Guduru, FOSDEM 2024. Original recording: 2024/k3201/fosdem-2024-3281-chorus-effortless-ceph-s3-petabyte-migration.av1.webm from the FOSDEM video archive. This channel is an unofficial mirror; FOSDEM is a free and non-commercial event organised by the community for the community. Wed, 21 Oct 2026 23:04:56 GMT https://validator.w3.org/feed/docs/rss2.html PeerTube - https://peertube.watch https://peertube.watch/lazy-static/avatars/3b284627-b75f-409e-ac2e-10f4c2946f43.png https://peertube.watch/videos/watch/1c8440ea-ab5a-45ad-b75d-123e29d74ef1 All rights reserved, unless otherwise specified in the terms specified at https://peertube.watch/about and potential licenses granted by each content's rightholder.