https://peertube.watch/videos/watch/82c46625-9484-4b5a-bde3-f202ca3a0c7b LINAGORA, as a leader in the Open LLM France community, has made it a priority to pull the curtain off of the process of building Large Language Models (LLMs). While most LLMs in use today – even the “open” ones – reveal few to no details about their training, and especially the data on which they are trained, we have decided to share it all. In this talk, we discuss why using an open model trained on traceable data is important for business and research alike and examine some of the difficulties involved in pursuing an open strategy for LLMs. We bring to the table our experience with data collection and training of LLMs, including the Claire family of language models. For links to the Claire models: Main model: huggingface.co/OpenLLM-France/Claire-7B-0.1 (CC BY-NC-SA 4.0), Main model in GGUF formats: huggingface.co/TheBloke/Claire-7B-0.1-GGUF, Variant model, license Apache: huggingface.co/OpenLLM-France/Claire-7B-Apache-0.1, Demo (simulated chat): huggingface.co/spaces/OpenLLM-France/Claire-Chat-0.1, Dataset & Code: Full dataset: huggingface.co/datasets/OpenLLM-France/Claire-Dialogue-French-0.1, Paper: arxiv.org/abs/2311.16840 “The Claire French Dialogue Dataset”; https://huggingface.co/papers/2311.16840 (with links to related assets), Databases survey: https://github.com/OpenLLM-France/Claire-datasets, Code for training: https://github.com/OpenLLM-France/Lit-Claire, Speaker: Julie Hunter, Track: AI and Machine Learning devroom, Room: UB2.252A (Lameere), When: Sunday 4 February 2024, 09:45–10:00 (Brussels time), Schedule: FOSDEM 2024 event page, Slides & links Slides, Licence: Creative Commons Attribution 2.0 Belgium (CC BY 2.0 BE) (as stated in the FOSDEM video archive). Attribution: “Building Open Source Language Models” by Julie Hunter, FOSDEM 2024. Original recording: 2024/ub2252a/fosdem-2024-2591-building-open-source-language-models.av1.webm from the FOSDEM video archive. This channel is an unofficial mirror; FOSDEM is a free and non-commercial event organised by the community for the community. Sun, 25 Oct 2026 01:55:23 GMT https://validator.w3.org/feed/docs/rss2.html PeerTube - https://peertube.watch https://peertube.watch/lazy-static/avatars/3b284627-b75f-409e-ac2e-10f4c2946f43.png https://peertube.watch/videos/watch/82c46625-9484-4b5a-bde3-f202ca3a0c7b All rights reserved, unless otherwise specified in the terms specified at https://peertube.watch/about and potential licenses granted by each content's rightholder.