{"v":1,"id":"model:hf:webAI-Official/TwIL-LM3","slug":"model-webai-official-twil-lm3","kind":"model","category":"llm","title":"TwIL-LM3","summary":"A 3B reasoning model for formal logic tasks, built from HuggingFaceTB/SmolLM3-3B through LoRA supervised fine-tuning, checkpoint fusion, WiSE-FT weight interpolation, and entropy-weighted GRPO reinfo…","source":{"provider":"hf","ref":"webAI-Official/TwIL-LM3","url":"https://huggingface.co/webAI-Official/TwIL-LM3","rev":"145ff05e92c6c6fe270d7ed741bc2c7bf40f3d40","fetchedAt":"2026-10-02T20:53:59.062Z","etag":"W/\"5705-gXKfhHmDcpu/myv6MdXoTgTMfoc\""},"author":{"name":"webAI-Official","url":"https://huggingface.co/webAI-Official"},"license":{"spdx":null,"raw":"other","url":"https://huggingface.co/webAI-Official/TwIL-LM3/blob/main/LICENSE.md","open":null,"note":"custom license: read it at the source before installing"},"metrics":{"downloads":314695,"downloadsWeek":327838,"likes":92,"stars":130156,"openIssues":2528,"lastRelease":{"tag":"v0.5.0","at":"2026-09-23T20:50:06Z"},"pushedAt":"2026-10-02T20:17:08Z","takenAt":"2026-10-02T20:53:59.062Z"},"tags":["transformers","safetensors","gguf","smollm3","text-generation","formal-logic","reasoning","lora","model-merging","wise-ft","reinforcement-learning","grpo","twil-lm","conversational","en","endpoints_compatible"],"pipeline":"text-generation","links":{"github":"ggml-org/llama.cpp","npm":"node-llama-cpp"},"updatedAt":"2026-10-01T17:37:49.000Z","collectedAt":"2026-10-02T20:53:59.062Z","review":{"numbers":["314,695 downloads on Hugging Face","92 likes","license other","1.8 GB for TwIL-LM3-Q4_K_M.gguf","130,156 stars on ggml-org/llama.cpp","2,528 open issues and PRs","last release v0.5.0 on 2026-09-23","327,838 npm downloads a week for node-llama-cpp","latest node-llama-cpp@3.22.1"],"log":null},"trust":"unlabeled","health":{"status":"alive","checkedAt":"2026-10-02T20:53:59.062Z","http":200},"description":"# TwIL-LM3\n\nA 3B reasoning model for **formal logic** tasks, built from\n[`HuggingFaceTB/SmolLM3-3B`](https://huggingface.co/HuggingFaceTB/SmolLM3-3B) through LoRA\nsupervised fine-tuning, checkpoint fusion, WiSE-FT weight interpolation, and entropy-weighted\nGRPO reinforcement learning.\n\nIt improves in-domain formal-logic performance by **+26% relative** over its base model\n(macro gate 0.336 → 0.422) **and improves held-out benchmark performance at the same time**\n(+0.022 core average). It is the only arm in this project that gains on both tracks, which is\nwhy it is the recommended release of the pair.\n\nTry out the model on our TwIL-LM3.1 branch, a better version of TwIL-LM3. \n\n## Highlights\n\n### Do check out our new model [TwIL-LM3-Pro](https://huggingface.co/webAI-Official/TwIL-LM3-Pro), a much better version of the TwIL-LM3 at 3.66B parameters. \n\n* **Gains on both tracks at once** — the only arm in this project that does. In-domain macro gate\n  0.336 → 0.422, and the held-out 10-dataset macro 0.7193 → 0.7339 rather than the usual collapse\n  that follows task-specific fine-tuning.\n* **Beats every arm up to and including LFM2.5-8B-A1B** — roughly three times its parameter count\n  — on all six Track A objective lanes and all four summary rows, not on average alone.\n* **Competitive with 8B on strict scoring.** On strict-7, which gives no loose-match credit\n  anywhere, it sits 0.012 behind Qwen3-8B (0.1971 against 0.2093) at 2.6x fewer parameters, and\n  ahead of it on Lean formalisation (token-F1 0.5869 against 0.4022) and semantic parsing (0.4416\n  against 0.4257).\n* **Structured formal output.** Tuned for the objects rather than the prose: FOL translation,\n  entailment labels, semantic parses, Lean statements and Lean proof critique.\n* **The most efficient arm measured, at any scale.** 482-token Track B generations and 32.9\n  completed answers per second — about eight times gpt-oss-120b's rate — because it answe…\n\nSource: https://huggingface.co/webAI-Official/TwIL-LM3","install":{"kind":"model","hfId":"webAI-Official/TwIL-LM3","gated":false,"format":"gguf","files":[{"name":"TwIL-LM3-F16.gguf","size":6158340256,"quant":"F16","sha256":"c0470a605df8457dd9a4e3c3357f6a5d8c995834aefbd7f3f4c4dbea8e39322c"},{"name":"TwIL-LM3-Q4_K_M.gguf","size":1915306144,"quant":"Q4_K_M","sha256":"e4eb515cceeae304ca4d5bc77447e7635143888afe2a6b37aac45c942dc36f54"},{"name":"TwIL-LM3-Q5_K_M.gguf","size":2213757088,"quant":"Q5_K_M","sha256":"9e423df5e640c6413498d990bee9baf88bc6eb32b30c74b38d4d9d0333f4cc82"},{"name":"TwIL-LM3-Q6_K.gguf","size":2530861216,"quant":"Q6_K","sha256":"4115749a6e507105fcd297c799e1fae8b0edb9f5b7d0c2aed75f505efef0f968"},{"name":"TwIL-LM3-Q8_0.gguf","size":3275575456,"quant":"Q8_0","sha256":"b6fc209a2b12c6d6d2316d3c3a563276adb7a7f76144c81f12eb2e600b465594"},{"name":"model.safetensors","size":6150235096,"sha256":"85a87a416ace45bf71a44db090108fef10f08a77a9381ba2471df5e8cca2d16e"}],"totalBytes":22244075256,"suggestedFile":"TwIL-LM3-Q4_K_M.gguf","requirements":{"ramGb":3,"diskBytes":1915306144,"note":"estimate: suggested file size × 1.15 + 0.5 GB; a real measurement comes with lsh models"},"runWith":["llama.cpp","ollama"],"command":"lsh models install hf:webAI-Official/TwIL-LM3"}}