DeepSeek V4 Flash / pelican-bicycle-svg-v1

Model evaluation sequence /tmp/deepseek-v4-q4-svg-pair-pack.json

Historical v2 reprojection of /tmp/deepseek-v4-q4-svg-pair-pack.json; generation timing was not recorded.

2026-07-11T01:55:58.636Z
2 tasks

Model Setup

DeepSeek V4 Flash

Model Setup identity
sha256:592e6e2b1b7b7328b8bd868b873a10d393e2260bebc2ddd25d1b81b2ce632028

Base model
DeepSeek V4 Flash

Quantization
unknown

Results

DeepSeek V4 Flash / pelican-bicycle-svg-v1

svg-artifact

manual_review

Wall time: 194.6 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:a34e4579317ee083082d289726133c3bfd55073ccaa10d133736f550538c8ef2
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

DeepSeek V4 Flash / goblin-motorcycle-svg-v1

svg-artifact

manual_review

Wall time: 346.1 s
Generation time: unknown
Generation TPS: unknown
Decoded tokens: unknown
Timing source: unknown
Output tokens: unknown

Attempt Fidelity

Task protocol: sha256:06ca2214c40fbf616c87ca1c04588d597a1259c4db0dd74c368a674f95ff7313
Assistance: native
Comparison: Eligible for automatic comparison consideration
Comparison reasons: none

Stewart Notes

# Stewart Notes

Model evaluation sequence /tmp/deepseek-v4-q4-svg-pair-pack.json

- Add observations here.

Edit notes.md in this static run folder to add observations without rerunning the model.