Best Small Language Models in Germany
View:
Compare the Top Small Language Models in Germany as of October 2026
Sort By:
What are Small Language Models in Germany?
Small Language Models (SLMs) are compact AI models designed to perform natural language understanding and generation tasks while requiring significantly fewer computational resources than large language models (LLMs). These models are optimized for low latency, lower memory usage, on-device inference, and cost-efficient deployment, making them well suited for edge devices, mobile applications, embedded systems, and enterprise workloads with strict performance or privacy requirements. SLMs can power applications such as chatbots, document summarization, code generation, classification, translation, question answering, and AI agents while delivering fast inference and reduced infrastructure costs. Many small language models are available as open-source or commercial offerings and integrate with AI frameworks, inference engines, cloud platforms, and developer tools for flexible deployment. By balancing performance, efficiency, and scalability, small language models help organizations build responsive, cost-effective AI applications across a wide range of environments. Compare and read user reviews of the best Small Language Models in Germany currently available using the table below. This list is updated regularly.
-
1
Arcee-SuperNova
Arcee.ai
Arcee-SuperNova is a small Language Model (SLM) with all the power and performance of leading closed-source LLMs. Excels at generalized tasks, instruction-following, and human preferences. The best 70B model on the market. SuperNova can be utilized for any generalized task, much like Open AI’s GPT4o, Claude Sonnet 3.5, and Cohere. Trained with the most advanced learning & optimization techniques, SuperNova generates highly accurate responses in human-like text. It's the most flexible, secure, and cost-effective language model on the market, saving customers up to 95% on total deployment costs vs. traditional closed-source models. Use SuperNova to integrate AI into apps and products, for general chat purposes, and for diverse use cases. Regularly update your models with the latest open-source tech, ensuring you're never locked into any one solution. Protect your data with industry-leading privacy measures.Starting Price: Free -
2
Ministral 3
Mistral AI
Mistral 3 is the latest generation of open-weight AI models from Mistral AI, offering a full family of models, from small, edge-optimized versions to a flagship, large-scale multimodal model. The lineup includes three compact “Ministral 3” models (3B, 8B, and 14B parameters) designed for efficiency and deployment on constrained hardware (even laptops, drones, or edge devices), plus the powerful “Mistral Large 3,” a sparse mixture-of-experts model with 675 billion total parameters (41 billion active). The models support multimodal and multilingual tasks, not only text, but also image understanding, and have demonstrated best-in-class performance on general prompts, multilingual conversations, and multimodal inputs. The base and instruction-fine-tuned versions are released under the Apache 2.0 license, enabling broad customization and integration in enterprise and open source projects.Starting Price: Free -
3
Tiny Aya
Cohere AI
Tiny Aya is a family of open-weight multilingual language models from Cohere Labs designed to deliver powerful, adaptable AI that can run efficiently on local devices, including phones and laptops, without requiring constant cloud connectivity. It focuses on enabling high-quality text understanding and generation across more than 70 languages, including many lower-resource languages that are often underserved by mainstream models. Built with lightweight architectures around 3.35 billion parameters, Tiny Aya is optimized for balanced multilingual representation and realistic compute constraints, making it suitable for edge deployment and offline use. The models support downstream adaptation and instruction tuning, allowing developers to customize behavior for specific applications while maintaining strong cross-lingual performance.Starting Price: Free -
4
distil labs
distil labs
distil labs optimizes AI workloads by replacing expensive frontier-model calls with custom small language models tuned to a specific task while maintaining the required quality bar. It observes real production traffic, captures traces from existing LLM requests, and automatically builds an evaluation set to understand how the workload actually behaves. It then generates and validates synthetic training data, matches the data distribution to the target workload, performs supervised fine-tuning and reinforcement learning, quantizes the model, and deploys an optimized endpoint. Results are automatically evaluated against the current model on accuracy, latency, and efficiency before teams choose to scale traffic. The resulting OpenAI-compatible endpoint combines a specialized SLM, prompt optimization, caching, and tuned serving for the use case.Starting Price: $0.04 per 1M tokens -
5
Solar Mini
Upstage AI
Solar Mini is a pre‑trained large language model that delivers GPT‑3.5‑comparable responses with 2.5× faster inference while staying under 30 billion parameters. It achieved first place on the Hugging Face Open LLM Leaderboard in December 2023 by combining a 32‑layer Llama 2 architecture, initialized with high‑quality Mistral 7B weights, with an innovative “depth up‑scaling” (DUS) approach that deepens the model efficiently without adding complex modules. After DUS, continued pretraining restores and enhances performance, and instruction tuning in a QA format, especially for Korean, refines its ability to follow user prompts, while alignment tuning ensures its outputs meet human or advanced AI preferences. Solar Mini outperforms competitors such as Llama 2, Mistral 7B, Ko‑Alpaca, and KULLM across a variety of benchmarks, proving that compact size need not sacrifice capability.Starting Price: $0.1 per 1M tokens -
6
Syn
Upstage AI
Syn is a next‑generation Japanese large language model co‑developed by Upstage and Karakuri, featuring under 14 billion parameters and optimized for enterprise use in finance, manufacturing, legal, and healthcare. It delivers top‑tier benchmark performance on the Weights & Biases Nejumi Leaderboard, achieving industry‑leading scores for accuracy and alignment, while maintaining cost efficiency through a lightweight architecture derived from Solar Mini. Syn excels in Japanese “truthfulness” and safety, understanding nuanced expressions and industry‑specific terminology, and offers flexible fine‑tuning to integrate proprietary data and domain knowledge. Built for scalable deployment, it supports on‑premises, AWS Marketplace, and cloud environments, with security and compliance safeguards tailored to enterprise requirements. Leveraging AWS Trainium, Syn reduces training costs by approximately 50 percent compared to traditional GPU setups, enabling rapid customization of use cases.Starting Price: $0.1 per 1M tokens -
7
LFM2
Liquid AI
LFM2 is a next-generation series of on-device foundation models built to deliver the fastest generative-AI experience across a wide range of endpoints. It employs a new hybrid architecture that achieves up to 2x faster decode and prefill performance than comparable models, and up to 3x improvements in training efficiency compared to the previous generation. These models strike an optimal balance of quality, latency, and memory for deployment on embedded systems, allowing real-time, on-device AI across smartphones, laptops, vehicles, wearables, and other endpoints, enabling millisecond inference, device resilience, and full data sovereignty. Available in three dense checkpoints (0.35 B, 0.7 B, and 1.2 B parameters), LFM2 demonstrates benchmark performance that outperforms similarly sized models in tasks such as knowledge recall, mathematics, multilingual instruction-following, and conversational dialogue evaluations. -
8
Jamba
AI21 Labs
Jamba is the most powerful & efficient long context model, open for builders and built for the enterprise. Jamba's latency outperforms all leading models of comparable sizes. Jamba's 256k context window is the longest openly available. Jamba's Mamba-Transformer MoE architecture is designed for cost & efficiency gains. Jamba offers key features of OOTB including function calls, JSON mode output, document objects, and citation mode. Jamba 1.5 models maintain high performance across the full length of their context window. Jamba 1.5 models achieve top scores across common quality benchmarks. Secure deployment that suits your enterprise. Seamlessly start using Jamba on our production-grade SaaS platform. The Jamba model family is available for deployment across our strategic partners. We offer VPC & on-prem deployments for enterprises that require custom solutions. For enterprises that have unique, bespoke requirements, we offer hands-on management, continuous pre-training, etc. -
9
Phi-4-reasoning
Microsoft
Phi-4-reasoning is a 14-billion parameter transformer-based language model optimized for complex reasoning tasks, including math, coding, algorithmic problem solving, and planning. Trained via supervised fine-tuning of Phi-4 on carefully curated "teachable" prompts and reasoning demonstrations generated using o3-mini, it generates detailed reasoning chains that effectively leverage inference-time compute. Phi-4-reasoning incorporates outcome-based reinforcement learning to produce longer reasoning traces. It outperforms significantly larger open-weight models such as DeepSeek-R1-Distill-Llama-70B and approaches the performance levels of the full DeepSeek-R1 model across a wide range of reasoning tasks. Phi-4-reasoning is designed for environments with constrained computing or latency. Fine-tuned with synthetic data generated by DeepSeek-R1, it provides high-quality, step-by-step problem solving. -
10
Phi-4-reasoning-plus
Microsoft
Phi-4-reasoning-plus is a 14-billion parameter open-weight reasoning model that builds upon Phi-4-reasoning capabilities. It is further trained with reinforcement learning to utilize more inference-time compute, using 1.5x more tokens than Phi-4-reasoning, to deliver higher accuracy. Despite its significantly smaller size, Phi-4-reasoning-plus achieves better performance than OpenAI o1-mini and DeepSeek-R1 at most benchmarks, including mathematical reasoning and Ph.D. level science questions. It surpasses the full DeepSeek-R1 model (with 671 billion parameters) on the AIME 2025 test, the 2025 qualifier for the USA Math Olympiad. Phi-4-reasoning-plus is available on Azure AI Foundry and HuggingFace. -
11
Phi-4-mini-reasoning
Microsoft
Phi-4-mini-reasoning is a 3.8-billion parameter transformer-based language model optimized for mathematical reasoning and step-by-step problem solving in environments with constrained computing or latency. Fine-tuned with synthetic data generated by the DeepSeek-R1 model, it balances efficiency with advanced reasoning ability. Trained on over one million diverse math problems spanning multiple levels of difficulty from middle school to Ph.D. level, Phi-4-mini-reasoning outperforms its base model on long sentence generation across various evaluations and surpasses larger models like OpenThinker-7B, Llama-3.2-3B-instruct, and DeepSeek-R1. It features a 128K-token context window and supports function calling, enabling integration with external tools and APIs. Phi-4-mini-reasoning can be quantized using Microsoft Olive or Apple MLX Framework for deployment on edge devices such as IoT, laptops, and mobile devices. -
12
Xgen-small
Salesforce
Xgen-small is an enterprise-ready compact language model developed by Salesforce AI Research, designed to deliver long-context performance at a predictable, low cost. It combines domain-focused data curation, scalable pre-training, length extension, instruction fine-tuning, and reinforcement learning to meet the complex, high-volume inference demands of modern enterprises. Unlike traditional large models, Xgen-small offers efficient processing of extensive contexts, enabling the synthesis of information from internal documentation, code repositories, research reports, and real-time data streams. With sizes optimized at 4B and 9B parameters, it provides a strategic advantage by balancing cost efficiency, privacy safeguards, and long-context understanding, making it a sustainable and predictable solution for deploying Enterprise AI at scale. -
13
Mu
Microsoft
Mu is a 330-million-parameter encoder–decoder language model designed to power the agent in Windows settings by mapping natural-language queries to Settings function calls, running fully on-device via NPUs at over 100 tokens per second while maintaining high accuracy. Drawing on Phi Silica optimizations, Mu’s encoder–decoder architecture reuses a fixed-length latent representation to cut computation and memory overhead, yielding 47 percent lower first-token latency and 4.7× higher decoding speed on Qualcomm Hexagon NPUs compared to similar decoder-only models. Hardware-aware tuning, including a 2/3–1/3 encoder–decoder parameter split, weight sharing between input and output embeddings, Dual LayerNorm, rotary positional embeddings, and grouped-query attention, enables fast inference at over 200 tokens per second on devices like Surface Laptop 7 and sub-500 ms response times for settings queries. -
14
Phi-4-mini-flash-reasoning
Microsoft
Phi-4-mini-flash-reasoning is a 3.8 billion‑parameter open model in Microsoft’s Phi family, purpose‑built for edge, mobile, and other resource‑constrained environments where compute, memory, and latency are tightly limited. It introduces the SambaY decoder‑hybrid‑decoder architecture with Gated Memory Units (GMUs) interleaved alongside Mamba state‑space and sliding‑window attention layers, delivering up to 10× higher throughput and a 2–3× reduction in latency compared to its predecessor without sacrificing advanced math and logic reasoning performance. Supporting a 64 K‑token context length and fine‑tuned on high‑quality synthetic data, it excels at long‑context retrieval, reasoning tasks, and real‑time inference, all deployable on a single GPU. Phi-4-mini-flash-reasoning is available today via Azure AI Foundry, NVIDIA API Catalog, and Hugging Face, enabling developers to build fast, scalable, logic‑intensive applications. -
15
Nemotron 3 Nano
NVIDIA
Nemotron 3 Nano is the smallest model in the NVIDIA Nemotron 3 family, built for agentic AI applications with strong reasoning, conversational ability, and cost-efficient inference. It is a hybrid Mamba-Transformer Mixture-of-Experts model with 3.2 billion active parameters, 3.6 billion including embeddings, and 31.6 billion total parameters. NVIDIA describes it as more accurate than the previous Nemotron 2 Nano while activating less than half of the parameters per forward pass, improving efficiency without sacrificing performance. The model is positioned as more accurate than GPT-OSS-20B and Qwen3-30B-A3B-Thinking-2507 on popular benchmarks across different categories. On an 8K input and 16K output setting using a single H200, it delivers inference throughput 3.3 times higher than Qwen3-30B-A3B and 2.2 times higher than GPT-OSS-20B. Nemotron 3 Nano supports context lengths up to 1 million tokens and is reported to outperform GPT-OSS-20B and Qwen3-30B-A3B-Instruct-2507. -
16
Aion 1.0 Instruct
Microsoft
Aion-1.0-Instruct is a pre-release small language model introduced in Microsoft Edge as a developer preview for early testing and feedback. It is designed to power Edge’s on-device Prompt and Writing Assistance APIs, giving web developers a faster, smaller, and more efficient model for AI-powered browser experiences. Microsoft previously used Phi-4-mini for these APIs, but its hardware requirements limited availability across devices. Aion-1.0-Instruct expands support to significantly more devices, including machines with less capable GPUs and, through CPU inference, devices without a GPU, while still delivering strong quality for a wide range of web use cases. The model is available in Edge Canary and Dev channels, allowing developers to evaluate it in real-world web scenarios, test API interoperability, and provide feedback before final optimizations. Aion-1.0-Instruct is meant to help developers build AI features directly into websites and browser extensions. -
17
Bonsai 27B
PrismML
Bonsai 27B is the new multimodal flagship of the Bonsai family and the first 27B-class model to run on a phone. Based on Qwen3.6 27B, it brings a new capability tier to local devices; multi-step reasoning, structured tool calls, vision tasks, and computer-use agentic loops that stay coherent across many steps. Bonsai 27B comes in two variants. Ternary Bonsai 27B uses ternary weights with FP16 group-wise scaling, giving 1.71 effective bits per weight and a 5.9 GB footprint for the quality-oriented laptop-class version. 1-bit Bonsai 27B uses binary weights with the same group-wise scaling, giving 1.125 effective bits per weight and a 3.9 GB footprint that fits within the memory budget of an iPhone 17 Pro. Both variants run end-to-end across the language network, embeddings, attention, MLPs, and LM head with no higher-precision escape hatches. They are multimodal, with a compact 4-bit vision tower, so on-device workflows can understand screenshots, documents, and camera input.
- Previous
- You're on page 1
- Next
