Qwen3.6 27B / creative-runtime-v0.1

Model evaluation sequence fast-evaluation-v1

Historical v2 reprojection of fast-evaluation-v1; generation timing was not recorded.

2026-07-10T14:37:10.931Z
9 tasks

Model Setup

Qwen3.6 27B

Model Setup identity
sha256:a01baf0434cb18132c86fbdbab00502f1318e7ed15736b70f47c6bd65f4dece1

Base model
Qwen3.6 27B

Quantization
4-bit

Results

Qwen3.6 27B / apple-product-landing

vision-only

not_applicable

Wall time: 0 ms
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:5ed4868ca43b9beb72337169fe965435f968e821ddb2b82204067e7b46c470b7
Assistance: unknown
Comparison: Context only
Comparison reasons: Not applicable, Unknown assistance

No publishable generated artifact for this task.

Qwen3.6 27B / github-issues

vision-only

not_applicable

Wall time: 0 ms
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:c10434eb22abe6e97d2bca712fa12b82d886b52d83634355b021ecade1731818
Assistance: unknown
Comparison: Context only
Comparison reasons: Not applicable, Unknown assistance

No publishable generated artifact for this task.

Qwen3.6 27B / ikea-product-page

vision-only

not_applicable

Wall time: 0 ms
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:e3b23d57aca09af66919af2a6d41208a3dfa7bb20bf2e33730d46b660df22c13
Assistance: unknown
Comparison: Context only
Comparison reasons: Not applicable, Unknown assistance

No publishable generated artifact for this task.

Qwen3.6 27B / wikipedia-article

vision-only

not_applicable

Wall time: 0 ms
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:55541eb41bc0bb0010b1cfde6ec6c5407428ceadd745e4abba29ee5116ff5457
Assistance: unknown
Comparison: Context only
Comparison reasons: Not applicable, Unknown assistance

No publishable generated artifact for this task.

Qwen3.6 27B / hacker-news

vision-only

not_applicable

Wall time: 0 ms
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:4bc475fb2981895204c7c097d9dd025e26c81e09d47f2b3c771b0913e84b6063
Assistance: unknown
Comparison: Context only
Comparison reasons: Not applicable, Unknown assistance

No publishable generated artifact for this task.

Qwen3.6 27B / creative-runtime-v0.1

visual-web-animation

pass

Wall time: 158.4 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:a72e42d63948dc930cece08ccb2a09bc03ad04075566fb5bc06168a979f42564
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.6 27B / pelican-bicycle-svg-v1

svg-artifact

manual_review

Wall time: 87 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:31d0492db6022484c687180d2e43d53bd12922e2e17cfdfa7eec46c011fa9c8e
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.6 27B / goblin-motorcycle-svg-v1

svg-artifact

reject

Wall time: 100.3 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:9fb2db7c2ffd0c6e79ad0a9bdc7c78864e3802ca9bf6e51218585d0eab27028b
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

No publishable generated artifact for this task.

Qwen3.6 27B / fireworks-fullscreen-animation-v1

visual-web-animation

manual_review

Wall time: 81.9 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:2456b7d44ec9323d2f5087b772d81a0d02b0dabc28ef182d9d432cac22333bd2
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Stewart Notes

# Stewart Notes

Model evaluation sequence fast-evaluation-v1

- Add observations here.

Edit notes.md in this static run folder to add observations without rerunning the model.