Workman AI Labs

The test history / Local AI

Models we’ve actually run

One Spark. Two Sparks. Mac Studio. Here is what we ran, what held up and why we kept or replaced it.

Records reviewed · Model & GitHub sources

Selected configurations from our retained run records—not every model we have tried. This is a test-history chart, not a universal leaderboard.

The chart at a glance

Recorded outcomes, not a common benchmark. Select a model for its evidence and limits. On a narrow screen, scroll the chart sideways.

First-party test history · records reviewed Oct 20, 2026
Model / variantRecorded outcomeWhy it is here
One DGX Spark
Qwen 3.8 Flash NextNVFP4 · Mia-AiLab artifactUpstream model ↗ Historical daily driver Historical fallback after EXL3 production failures; quality limits remained.
Two DGX Sparks
DeepSeek-V4.1-Flash-1017EAQ v1 EXL3 · 2.9 bpwMia model card ↗ Our recorded pair choice Adopted October 19 after quality and serving checks; not a live-status claim.
GLM-5.3-Flash-EXL3EXL3 · historical paired servingUpstream model ↗ Former pair choice Former production model; replaced after the separate DeepSeek qualification.
Mac Studio test history
MiniCPM-V 4.7 35B-A3BQ4_K_M · llama.cpp · M3 Ultra / 96 GiBTested Q4_K_M file · pinned ↗ Current Studio choice Our selected Studio model; live identity, hardware and exact pinned weight file verified October 20.
Ornith 1.0 35BQ4_K_M · OllamaUpstream model ↗ Tested with failures 248 actual responses; coding/reasoning failures prevent a clean recommendation.
Ornith 1.5 9BBF16, Q4_K_M, Q6_K and Q8_0 screensUpstream model ↗ Screened; not promoted Separate quantization screens stayed report-only; no promotion.
Ornith 1.5 35B-A3BBF16, Q4_K_M, Q6_K and Q8_0 screensUpstream model ↗ Screened; not promoted Separate quantization screens stayed report-only; no promotion.
Gemma 4 12B OBLITERATUSCommunity-modified Q4_K_M · OllamaCommunity-modified model ↗ Tested with failures 248 actual responses; coding failures and an unranked category.
Execution verified. Hardware binding incomplete.
Qwen 3.8 Flash NextEXL3 · 3.05 bpwRecorded EXL3 repository ↗ Rolled back Rolled back after degeneration and sustained freezes despite earlier test gains.
Qwen 3.8 Flash NextEXL3 · 4.05 bpwRecorded EXL3 repository ↗ Rejected in task testing Recorded task failures, including command safety; higher bits did not qualify it.
Qwen 3.8 27BUnsloth NVFP4Unsloth model card ↗ Tested; recipe incomplete Generation verified; exact historical node count and runtime build unresolved.
MiniCPM — earlier article trialRecorded runtime label: minicpm-v47Model family reference only ↗ Generation verified; identity incomplete Saved generations verified; exact weights/hardware and factual review unresolved.

What the labels mean

First-party tested means execution evidence exists, not that the model passed or is recommended. The outcome label is separate.

Recorded choice
A dated adoption for our workload, not a universal recommendation or live status.
Historical
Previously used or selected; not a claim about today’s route.
Limited / not promoted
Execution or screening is recorded, with failures or qualification limits.
Rolled back / rejected
The configuration was withdrawn or did not qualify in the recorded testing.
Unresolved
Generation is verified, but identity, hardware or recipe evidence is incomplete.

Hardware / Test records

One DGX Spark

Single-rank startup is verified for the NVFP4 configuration below. That proof does not automatically cover the separately tested EXL3 variants.

  • Qwen 3.8 Flash Next

    NVFP4 · Mia-AiLab artifact

    First-party tested Historical daily driver

    Test / record date: September 2026

    Workload
    Local generation and agent-style tasks
    Evidence
    Saved generation responses and a completed historical task battery. Some quality components remained on hold.
    Decision / why kept or replaced
    Retained historically as the fallback after the faster EXL3 setup failed in production. It did not clear every quality check.
    Limits
    vLLM. Exact earlier runtime build is not fully bound. The recorded Mia NVFP4 repository was not publicly accessible at this review; the upstream link is a family reference, not a substitute artifact. This is historical use, not proof of today’s routing.
    Configuration & evidence notes for Qwen 3.8 Flash Next, NVFP4 · Mia-AiLab artifact
    • Recorded artifact: Mia-AiLab/Qwen3.8-Flash-Next-NVFP4.
    • Recorded revision: 925d7be6c14c6c9442ef83e8f05b5a3c39304f69.
    • September startup records show one GPU/rank. Do not transfer this topology claim to other quantizations.
Back to hardware index ↑

Hardware / Test records

Two DGX Sparks

These records establish paired serving. They are not single-Spark results, and they do not establish what three or four Sparks would do.

  • DeepSeek-V4.1-Flash-1017

    EAQ v1 EXL3 · 2.9 bpw

    First-party tested Our recorded pair choice · recorded October 19–20, 2026

    Test / record date: October 19–20, 2026

    Workload
    Our paired local agent/tool workload
    Evidence
    The October 19 qualification passed 12/12 tasks in each of three repeats. Two GB10 nodes are documented; an October 20 read-only capture reports this served model.
    Decision / why kept or replaced
    Adopted on October 19 after meeting our quality and serving gates. The recorded comparison found a quality tie with the prior configuration and passed the speed gates.
    Limits
    Not a claim of global superiority. The October 20 serving settings differ from the adoption settings; they must not be combined into one recipe.
    Configuration & evidence notes for DeepSeek-V4.1-Flash-1017, EAQ v1 EXL3 · 2.9 bpw
    • Recorded artifact: Mia-AiLab/DeepSeek-V4.1-Flash-1017-EXL3-EAQ-v1-2.9-bpw.
    • Recorded artifact revision: 6d54be4fca338d79b17c3b03cc9a423bb3ac6718.
    • TensorFold native Zig serving. The exact configuration must accompany any future setup recipe.
    • The verified release identifier is 1017. No parameter count is inferred from that release identifier.
  • GLM-5.3-Flash-EXL3

    EXL3 · historical paired serving

    First-party tested Former pair choice

    Test / record date: October 2026

    Workload
    Paired local serving and bounded tool/code tasks
    Evidence
    Three October 17–18 v3 runs each scored 11/12. Later v4 decision records report 12/12. These are different packs, not directly comparable scores.
    Decision / why kept or replaced
    Our former production route. The October 19 decision replaced it with DeepSeek after the separate quality and serving checks.
    Limits
    Repeated prompt-contract tests measure that intervention, not superiority over other models. The exact historical weight revision is not bound to every run.
    Configuration & evidence notes for GLM-5.3-Flash-EXL3, EXL3 · historical paired serving
    • Historical two-rank loading and paired recipe records were checked.
    • The retained TensorFold recipe and the historical test runs are separate evidence. A current recipe default is not a lockfile for every past run.
    • Replacement does not mean the model was universally worse.
Back to hardware index ↑

Hardware / Test records

Mac Studio test history

The current MiniCPM deployment is verified on an Apple M3 Ultra with 96 GiB unified memory. Older Ornith and Gemma runs identify a Studio host class but do not establish each historical run’s chip and RAM. No M3 Ultra 96GB-specific benchmark or fit claim is made for those older runs.

  • MiniCPM-V 4.7 35B-A3B

    Q4_K_M · llama.cpp · M3 Ultra / 96 GiB

    Deployment + artifact verified Current Studio choice · recorded Deployment and artifact verified October 20, 2026

    Test / record date: Deployment and artifact verified October 20, 2026

    Workload
    Local drafting and structured text generation
    Evidence
    Read-only checks confirmed the M3 Ultra, 96 GiB RAM, loaded model identity and selection by the current workload routes. The 21,166,255,008-byte Q4_K_M file matches the SHA-256 published at a pinned OpenBMB revision.
    Decision / why kept or replaced
    This is the model we currently select on the Studio for this workload. That makes it our Studio choice, not a claim that it beats every model or hardware configuration. Earlier article trials are recorded separately below.
    Limits
    Four configured slots each have 16,384 tokens of effective context: 65,536 total is not a 65,536-token per-request allowance. This review checked the deployed identity and artifact without new inference; it is not a fresh comparative quality or speed benchmark.
    Configuration & evidence notes for MiniCPM-V 4.7 35B-A3B, Q4_K_M · llama.cpp · M3 Ultra / 96 GiB
    • Recorded file: MiniCPM-V-4_7-35B-A3B-Q4_K_M.gguf.
    • Verified OpenBMB revision: b28c15b3cea97880196158a5c0a8feeab5ed36b6.
    • Verified file SHA-256: bf3d1c67f7843193e4483aebd26c5dea6b6d1f6a06ffa03c2387a6f3cc6d7df5.
    • Runtime reports llama.cpp build b1-358a420. The inspected server uses no reasoning budget.
    • The repository head now contains different bytes. Use the pinned file link to identify the file we verified, rather than assuming today’s main branch is identical.
  • Ornith 1.0 35B

    Q4_K_M · Ollama

    First-party tested Tested with failures

    Test / record date: Historical run records reviewed October 20, 2026

    Workload
    Coding, instruction following, reasoning and structured output
    Evidence
    248 trial receipts were reconciled with 248 actual, nonempty HTTP 200 responses. Coding and reasoning critical failures are present in the grading records.
    Decision / why kept or replaced
    The run history supports a tested entry, not a clean all-purpose recommendation. Returning an answer did not mean the answer passed.
    Limits
    Studio attribution is recorded; exact historical chip/RAM is not. Do not carry these results over to Ornith 1.5.
    Configuration & evidence notes for Ornith 1.0 35B, Q4_K_M · Ollama
    • The primary saved responses, returned model identity and model digest were reconciled independently.
    • 248 is a response count, not 248 successful trials.
  • Ornith 1.5 9B

    BF16, Q4_K_M, Q6_K and Q8_0 screens

    First-party tested Screened; not promoted

    Test / record date: Historical screening records reviewed October 20, 2026

    Workload
    Candidate task screening
    Evidence
    Actual saved HTTP 200 responses exist for each listed variant. Those screens were held as report-only; the historical decision records no promotion.
    Decision / why kept or replaced
    Not promoted in the recorded campaign. A screening run is not sustained operational qualification.
    Limits
    The listed quantizations are separate test arms. There is no combined score or blanket recommendation for this family.
    Configuration & evidence notes for Ornith 1.5 9B, BF16, Q4_K_M, Q6_K and Q8_0 screens
    • Studio host class and separate artifact/quantization records were checked.
    • Failed zero-call launches were kept separate from actual model responses; a failed launch is not a model-quality result.
  • Ornith 1.5 35B-A3B

    BF16, Q4_K_M, Q6_K and Q8_0 screens

    First-party tested Screened; not promoted

    Test / record date: Historical screening records reviewed October 20, 2026

    Workload
    Candidate task screening
    Evidence
    Actual saved HTTP 200 responses exist for each listed variant. The screens remained report-only, not a clean promotion result.
    Decision / why kept or replaced
    The historical campaign ended without promotion. These results are kept separate from the 9B model and Ornith 1.0.
    Limits
    Exact historical chip/RAM remains unresolved. No fit, speed or quality claim is transferred between the quantizations.
    Configuration & evidence notes for Ornith 1.5 35B-A3B, BF16, Q4_K_M, Q6_K and Q8_0 screens
    • Only variants with saved model execution are listed here.
    • A separately attempted zero-call variant is not counted as a completed model test.
  • Gemma 4 12B OBLITERATUS

    Community-modified Q4_K_M · Ollama

    First-party tested Tested with failures

    Test / record date: Historical run records reviewed October 20, 2026

    Workload
    Coding, instruction following, reasoning and structured output
    Evidence
    248 trial receipts were reconciled with 248 actual, nonempty HTTP 200 responses. Coding failures are recorded; structured transformation was unranked.
    Decision / why kept or replaced
    Not a blanket recommendation. The grading limits are part of the result, not something to hide behind a response count.
    Limits
    This is a community-modified variant, not evidence about every Gemma model. The exact historical Studio chip/RAM is not established.
    Configuration & evidence notes for Gemma 4 12B OBLITERATUS, Community-modified Q4_K_M · Ollama
    • Primary raw responses and the recorded model digest were reconciled.
    • The unranked category is not treated as passing or assigned an invented score.
Back to hardware index ↑

Hardware / Test records

Execution verified. Hardware binding incomplete.

These records prove more than downloaded weights or a configured name. They still do not establish every field needed for a hardware-specific recommendation.

  • Qwen 3.8 Flash Next

    EXL3 · 3.05 bpw

    First-party tested Rolled back

    Test / record date: September 18, 2026

    Workload
    DGX agent-style tasks and production exposure
    Evidence
    Actual quality and serving tests preceded a cutover. Production degeneration and sustained engine freezes were then recorded.
    Decision / why kept or replaced
    Rolled back despite the earlier task/speed gains. A faster short test did not establish reliable operation.
    Limits
    DGX assignment is recorded; variant-specific physical GPU inventory is not fully bound. Do not reuse the NVFP4 topology proof.
    Configuration & evidence notes for Qwen 3.8 Flash Next, EXL3 · 3.05 bpw
    • Recorded artifact: turboderp/Qwen3.8-Flash-Next-exl3, named revision 3.05bpw_h5_ng5.
    • vLLM 0.29.0 plus vllm-exl3. A named revision is not an independently verified immutable commit.
  • Qwen 3.8 Flash Next

    EXL3 · 4.05 bpw

    First-party tested Rejected in task testing

    Test / record date: September 18, 2026

    Workload
    DGX agent-style task testing
    Evidence
    A completed report-only battery retained code-repair and command-safety failures.
    Decision / why kept or replaced
    The higher-bit variant did not qualify better. More bits did not erase the observed task failures.
    Limits
    Exact immutable weight revision and variant-specific physical GPU inventory remain unresolved. This is not the NVFP4 result.
    Configuration & evidence notes for Qwen 3.8 Flash Next, EXL3 · 4.05 bpw
    • Recorded artifact family: turboderp/Qwen3.8-Flash-Next-exl3.
    • The command-safety result belongs to this configuration; no claim is made about all Qwen models.
  • Qwen 3.8 27B

    Unsloth NVFP4

    First-party tested Tested; recipe incomplete

    Test / record date: Historical run records reviewed October 20, 2026

    Workload
    Synthetic DGX task generations
    Evidence
    Actual task outputs and the Unsloth served identity were verified. The records establish a DGX host, not the exact historical node count.
    Decision / why kept or replaced
    Keep this tested configuration distinct from OrcaRouter’s 27B variant. A result from one is not a result from the other.
    Limits
    Exact historical node count and runtime build remain unresolved. No one-Spark recipe or current recommendation is inferred.
    Configuration & evidence notes for Qwen 3.8 27B, Unsloth NVFP4
    • Recorded artifact: unsloth/Qwen3.8-27B-NVFP4.
    • The hardware gap is explicit rather than filled from recollection.
  • MiniCPM — earlier article trial

    Recorded runtime label: minicpm-v47

    First-party tested Generation verified; identity incomplete

    Test / record date: October 16, 2026

    Workload
    A bounded article-generation trial
    Evidence
    16 saved, nonempty response files were checked by checksum on the execution host. The retained 1,709-word draft also matches its recorded checksum.
    Decision / why kept or replaced
    Actual generation occurred. Human factual review was still pending; a returned draft is not a quality pass.
    Limits
    This October 16 trial’s exact checkpoint and hardware binding remain unresolved. The current Studio entry is separately verified; its identity is not retroactively assigned to this earlier trial. The source link is a model-family reference only.
    Configuration & evidence notes for MiniCPM — earlier article trial, Recorded runtime label: minicpm-v47
    • The generated response files were verified on their execution host, not assumed missing because they were absent on another machine.
    • The recorded model profile is minicpm-v47. The exact weights must be bound before a reproducible setup guide or hardware recommendation.
Back to hardware index ↑

Sources & upstream projects

Credit belongs to the model authors, quantizers and runtime developers. These are upstream references, not Workman test receipts. An upstream model card is not a claim that its current weights match every historical run; exact pinned artifacts are labeled separately.

Before using these results

  • Our recorded pair choice describes an October 19 adoption decision and an October 20 identity capture. It is not a live availability indicator.
  • Tested, screened, adopted and sustained operation are different claims. A retained historical decision is not proof of today’s routing.
  • Only configurations backed by first-party run evidence earn a tested entry. Staged weights, configured aliases and zero-call failures do not.
  • Check the exact artifact’s current license before business use. Successful generation does not establish commercial permission.
  • No throughput leaderboard or universal recommendation is inferred across these different packs, runtimes and workloads.

We checked the underlying run records and saved outputs. Production prompts, business inputs, private hosts and detailed operating playbooks stay private.