<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
    <channel>
        <title>8B vs 402B at Picking Tools: The Student Beat Its Teacher (Preprint)</title>
        <link>https://peertube.watch/videos/watch/e41a36bf-ae88-4a95-9342-0fb9c30d7a84</link>
        <description>Peace Call. Mr. Peace is an AI-made character; voice is AI-generated; script written with AI assistance. No affiliate links in this video. How this site is run: https://getpeacecall.com/verify/?utm_source=peertube&amp;utm_medium=video&amp;utm_campaign=underdog-long01 Scope (read this first): this video covers ONE benchmark comparison — ToolBench G3 exact-match tool selection (2,124 held-out requests). It is NOT a claim that small models beat large models in general, and NOT a claim about tool execution success, cost, latency, or customer outcomes. Cold-open clarification: "fifty times smaller" means total parameters (402B vs 8B). Maverick only activates about 17B parameters at once (~2× the 8B's active size, per the paper). Training also differs: the student (Qwen3-8B) was fine-tuned for tool selection; the giant (Llama-4-Maverick) was prompted in four setups, and we cite its best prompted score. Headline result: trained Qwen3-8B 41.5% vs prompted Llama-4-Maverick best 30.6% on ToolBench G3 exact match. The student was tested on held-out tool-selection tasks (not the training examples). Maverick helped create the training data ("teacher"), then the student beat that teacher on the held-out G3 test. The small model also led on G2 25.8 vs 20.8, Gorilla 29.9 vs 16.0, CRAFT 69.0 vs 47.9 (no extra training). Catch: on TaskBench the giant wins 80.6% vs 72.8%. Limits: TaskBench is 103 tasks, single runs, trained vs prompted, checkpoints not released, PREPRINT (not peer-reviewed). 0:00 8B beat 402B? 0:25 Parameters, quickly 0:47 The test and the giant's 4 tries 1:28 Why it matters (preprint, Meta vs Meta) 2:14 How tool picking works 4:13 The twist: the teacher 4:49 New tests 5:17 Where the giant wins 5:56 The fine print 6:37 Recap Source: Zhou et al., 'Training Small Language Models for Transferable Tool Selection', arXiv:2610.31483 — PREPRINT, submitted Oct 22, 2026, not yet peer reviewed (Meta / Carnegie Mellon University). https://arxiv.org/abs/2610.31483 . Numbers from Tables 1-2, Sections 3-4 and Appendix A.1 (checked 2026-10-31, 2026-11-01, and 2026-11-09). Model names are trademarks of their owners. Not affiliated with or endorsed by Meta, Alibaba/Qwen or the authors. Charts are drawn by our code from the paper's numbers (not AI-generated). Mr. Peace is an AI-made character with an AI voice. Our arithmetic (not from the paper): 402 / 8 ≈ 50x total; 80.6 - 72.8 = 7.8 points ('about 8'). AI Disclosure: Mr. Peace is a fictional AI character using a synthetic voice. This video is AI-assisted. Research Disclosure: based on a preprint, not peer-reviewed. YouTube original: https://youtu.be/vJUmvKB148o</description>
        <lastBuildDate>Mon, 16 Nov 2026 07:13:36 GMT</lastBuildDate>
        <docs>https://validator.w3.org/feed/docs/rss2.html</docs>
        <generator>PeerTube - https://peertube.watch</generator>
        <image>
            <title>8B vs 402B at Picking Tools: The Student Beat Its Teacher (Preprint)</title>
            <url>https://peertube.watch/lazy-static/avatars/3b284627-b75f-409e-ac2e-10f4c2946f43.png</url>
            <link>https://peertube.watch/videos/watch/e41a36bf-ae88-4a95-9342-0fb9c30d7a84</link>
        </image>
        <copyright>All rights reserved, unless otherwise specified in the terms specified at https://peertube.watch/about and potential licenses granted by each content's rightholder.</copyright>
        <atom:link href="https://peertube.watch/feeds/video-comments.xml?videoId=e41a36bf-ae88-4a95-9342-0fb9c30d7a84" rel="self" type="application/rss+xml"/>
    </channel>
</rss>