What “lean” means here
We optimize the serving system as a whole rather than making an unqualified claim about a single hardware number.The public API does not publish a fixed GPU, RAM, quantization, or provider configuration. Hardware is a deployment variable; the public promise is the measured service behavior and the reproducible protocol below.
Why this matters
The largest deployment is not automatically the best deployment. For a focused Arabic workflow, the useful measure is quality per accepted outcome: the quality that survives review, divided by the time, tokens, and operational cost required to create it. This framing avoids two common errors:- Comparing parameter counts while ignoring latency, retries, output waste, and human editing.
- Announcing a tiny hardware footprint without saying what concurrency, context length, quality setting, region, or failure rate it supports.
Deployment profile: what we measure
Before calling a deployment profile “low-spec,” record the following alongside the result. This makes the claim auditable across environments.A responsible comparison
Mibyan should be compared with a frontier model on the same held-out Arabic workload, not by implying that either model is universally better. A frontier model can lead on breadth, multimodality, or difficult open-ended reasoning. Mibyan may be the better operational choice when Arabic terminology, structured business work, stable integration, and a lean controlled serving path are decisive. The comparison must hold constant the prompt, context, output cap, temperature, tools, retry policy, region, and scoring rubric. See the benchmark protocol for the full reporting contract.Operator checklist
- Start with a representative held-out Arabic workload, not demo prompts.
- Run a baseline with the intended concurrency and context limits.
- Capture latency, reliability, and quality together; do not optimize one in isolation.
- Classify every failure: timeout, missed constraint, bad Arabic, unsupported task, tool error, or factual error.
- Compare accepted outputs—not just raw tokens or a single leaderboard score.
- Publish a dated deployment manifest before turning an internal efficiency result into a public numerical claim.