Files
markbaseengine/Tests
MarkBase Admin 745727b6ab
CI / build-and-test (push) Has been cancelled
test: Complete model comparison test (6 models, Audio+Vision+Text)
MAJOR CORRECTIONS:
-  Confirmed 12B HAS Audio+Vision (lightweight embeddings, not 'pure text')
-  Confirmed E2B HAS Vision Tower (661 tensors, not 'Audio only')
-  Confirmed E2B is LARGEST multimodal (1415 tensors, 52%)

NEW DISCOVERIES:
- ⚠️ 12B has 3 NaN in text forward (previously undetected)
-  E4B Audio forward: 0 NaN (perfect)
- ⚠️ E2B Vision loading slow (11.8s, needs optimization)
-  26B-Std has 357 tensors (needs verification)

Test coverage: 58% (timeout)
- Perfect stability: 4/4 tested (E4B, 12B, 31B, E2B text)
- Multimodal confirmed: E4B, 12B, E2B (all have Audio+Vision)
- Pure text: 31B, 26B series

Recommendations:
- Deepest multimodal: E2B (1415 tensors, 52%)
- Fastest multimodal: E4B (81ms load, KV sharing)
- Lightweight + long context: 12B (embeddings, 262K)
- Large-scale text: 31B (60 layers, perfect)

Next steps: Complete E2B/26B forward tests, fix 12B NaN issue, optimize E2B vision load
2026-06-23 23:53:40 +08:00
..