Qwen3.6 27B / creative-runtime-v0.1

Model evaluation sequence text-only-animation-suite-v1

Historical v2 reprojection of text-only-animation-suite-v1; generation timing was not recorded.

2026-07-11T06:23:34.678Z
8 tasks

Model Setup

Qwen3.6 27B

Model Setup identity
sha256:ab270450a6fcf17f643b63cb6d888d4e5a976d239f0af672246364dadd9c93d0

Base model
Qwen3.6 27B

Quantization
4-bit

Results

Qwen3.6 27B / creative-runtime-v0.1

visual-web-animation

manual_review

Wall time: 168.5 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:88fc50499a1eb9ed37c663abbb3cb531884b271dfc04a26fccacc33bb2b45257
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.6 27B / fireworks-canvas-demo-v1

visual-web-animation

manual_review

Wall time: 77.1 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:2fc2ae225b9298256eb04ef1b24b5af06a6678e31d5c63d47b70a6e0416db835
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.6 27B / fireworks-fullscreen-animation-v1

visual-web-animation

manual_review

Wall time: 95.5 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:c23440d88b02ea305145bc4c6bf93c9452d4116a928e6c187a8065a88be87c5a
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.6 27B / miami-vice-flamingos-v1

visual-web-animation

manual_review

Wall time: 154.3 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:796df2e919d5f2d14c8e04ff022b8700bccf61aa7a11d1d4d561993114cf5867
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.6 27B / gravity-garden-v1

visual-web-animation

manual_review

Wall time: 104.6 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:decb5da3d8a1c47445102d1b15e3e2c9186b852810ba3ca38407f412476dea71
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.6 27B / warehouse-robot-sorter-v1

visual-web-animation

reject

Wall time: 392 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:ccc7e45c0c27265849f73eeb822f79d156a6cacc2eddd246d2b7270afe9fb22b
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

No publishable generated artifact for this task.

Qwen3.6 27B / pelican-bicycle-svg-v1

svg-artifact

manual_review

Wall time: 82 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:a34e4579317ee083082d289726133c3bfd55073ccaa10d133736f550538c8ef2
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.6 27B / goblin-motorcycle-svg-v1

svg-artifact

manual_review

Wall time: 97.7 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:06ca2214c40fbf616c87ca1c04588d597a1259c4db0dd74c368a674f95ff7313
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Stewart Notes

# Stewart Notes

Model evaluation sequence text-only-animation-suite-v1

- Add observations here.

Edit notes.md in this static run folder to add observations without rerunning the model.