DeepSeek V4 Flash / pelican-bicycle-svg-v1

Model evaluation sequence /tmp/deepseek-v4-q4-svg-pair-pack.json

Historical v2 reprojection of /tmp/deepseek-v4-q4-svg-pair-pack.json; generation timing was not recorded.

2026-07-11T02:54:58.837Z
2 tasks

Model Setup

DeepSeek V4 Flash

Model Setup identity
sha256:2cfb854ddce38d8d0360916ea77136f32214127827b8a0fc2e6e8f4bc046d020

Base model
DeepSeek V4 Flash

Quantization
unknown

Results

DeepSeek V4 Flash / pelican-bicycle-svg-v1

svg-artifact

manual_review

Wall time: 235.4 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:a34e4579317ee083082d289726133c3bfd55073ccaa10d133736f550538c8ef2
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

DeepSeek V4 Flash / goblin-motorcycle-svg-v1

svg-artifact

manual_review

Wall time: 207.6 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:06ca2214c40fbf616c87ca1c04588d597a1259c4db0dd74c368a674f95ff7313
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Stewart Notes

# Stewart Notes

Model evaluation sequence /tmp/deepseek-v4-q4-svg-pair-pack.json

- Add observations here.

Edit notes.md in this static run folder to add observations without rerunning the model.