Qwen3.5 9B / miami-vice-flamingos-v1

Model evaluation sequence text-only-animation-suite-v1

Historical v2 reprojection of text-only-animation-suite-v1; generation timing was not recorded.

2026-07-11T13:59:03.334Z
8 tasks

Model Setup

Qwen3.5 9B

Model Setup identity
sha256:6816d91c044955f7fed9fe9a2d6c9ac43a43f82a38b1d01dbbf9b4c0ac6cd67b

Base model
Qwen3.5 9B

Quantization
4-bit

Results

Qwen3.5 9B / creative-runtime-v0.1

visual-web-animation

reject

Wall time: 92.5 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:88fc50499a1eb9ed37c663abbb3cb531884b271dfc04a26fccacc33bb2b45257
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

No publishable generated artifact for this task.

Qwen3.5 9B / fireworks-canvas-demo-v1

visual-web-animation

reject

Wall time: 36.2 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:2fc2ae225b9298256eb04ef1b24b5af06a6678e31d5c63d47b70a6e0416db835
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

No publishable generated artifact for this task.

Qwen3.5 9B / fireworks-fullscreen-animation-v1

visual-web-animation

reject

Wall time: 50.8 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:c23440d88b02ea305145bc4c6bf93c9452d4116a928e6c187a8065a88be87c5a
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

No publishable generated artifact for this task.

Qwen3.5 9B / miami-vice-flamingos-v1

visual-web-animation

manual_review

Wall time: 47.2 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:796df2e919d5f2d14c8e04ff022b8700bccf61aa7a11d1d4d561993114cf5867
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.5 9B / gravity-garden-v1

visual-web-animation

reject

Wall time: 165.4 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:decb5da3d8a1c47445102d1b15e3e2c9186b852810ba3ca38407f412476dea71
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

No publishable generated artifact for this task.

Qwen3.5 9B / warehouse-robot-sorter-v1

visual-web-animation

reject

Wall time: 60.9 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:ccc7e45c0c27265849f73eeb822f79d156a6cacc2eddd246d2b7270afe9fb22b
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

No publishable generated artifact for this task.

Qwen3.5 9B / pelican-bicycle-svg-v1

svg-artifact

manual_review

Wall time: 39.4 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:a34e4579317ee083082d289726133c3bfd55073ccaa10d133736f550538c8ef2
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Qwen3.5 9B / goblin-motorcycle-svg-v1

svg-artifact

manual_review

Wall time: 43.6 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:06ca2214c40fbf616c87ca1c04588d597a1259c4db0dd74c368a674f95ff7313
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Stewart Notes

# Stewart Notes

Model evaluation sequence text-only-animation-suite-v1

- Add observations here.

Edit notes.md in this static run folder to add observations without rerunning the model.