https://peertube.watch/videos/watch/88e7c945-e137-4e08-b275-206ee1f3d1f9 Flakes aka tests that don’t behave deterministically, i.e. they fail sometimes and pass sometimes, are an ever recurring problem in software development. This is especially the sad reality when running e2e tests where a lot of components are involved. There are various reasons why a test can be flaky, however the impact can be as fatal as CI being loaded beyond capacity causing overly long feedback cycles or even users losing trust in CI itself. For the KubeVirt project we want to remove flakes as fast as possible to minimize the number of retests required. This leads to shorter time to merge, reduces CI user frustration, improves trust in CI, while at the same time it decreases the overall load for the CI system. We start by generating a report of tests that have failed at least once inside a merged PR, meaning that in the end all tests have succeeded, thus flaky tests have been run inside CI. We then look at the report to separate flakes from real issues and forward the flakes to dev teams. As a result retest numbers have gone down significantly over the last year. After attending the session the user will have an idea of what our flake process is, how we exercise it and what the actual outcomes are. Speaker: Daniel Hiller, Track: Testing and Continuous delivery devroom, Room: UD2.208 (Decroly), When: Sunday 4 February 2024, 11:10–11:40 (Brussels time), Schedule: FOSDEM 2024 event page, Slides & links Talk Slides PDF, KubeVirt, KubeVirt CI health reports, Licence: Creative Commons Attribution 2.0 Belgium (CC BY 2.0 BE) (as stated in the FOSDEM video archive). Attribution: “squash the flakes! - how to minimize the impact of flaky tests” by Daniel Hiller, FOSDEM 2024. Original recording: 2024/ud2208/fosdem-2024-1805-squash-the-flakes-how-to-minimize-the-impact-of-flaky-tests.av1.webm from the FOSDEM video archive. This channel is an unofficial mirror; FOSDEM is a free and non-commercial event organised by the community for the community. Mon, 26 Oct 2026 02:10:15 GMT https://validator.w3.org/feed/docs/rss2.html PeerTube - https://peertube.watch https://peertube.watch/lazy-static/avatars/3b284627-b75f-409e-ac2e-10f4c2946f43.png https://peertube.watch/videos/watch/88e7c945-e137-4e08-b275-206ee1f3d1f9 All rights reserved, unless otherwise specified in the terms specified at https://peertube.watch/about and potential licenses granted by each content's rightholder.