 MarkBase Admin
|
f15730ddc3
|
fix: Correct E2B model Vision capabilities (SECOND MAJOR FIX)
CI / build-and-test (push) Has been cancelled
CRITICAL CORRECTION #2:
- ❌ Previous reports incorrectly stated E2B as 'Audio only, no Vision'
- ✅ E2B HAS complete Vision Tower (verified via config.json + safetensors)
- Vision Tower: 661 tensors (16 layers, 768 hidden, 12 heads)
- Audio Tower: 754 tensors (12 layers, 1024 hidden, 8 heads)
- Total multimodal: 1415 tensors (52% of model) ← LARGEST!
Key findings:
- E2B is LARGEST multimodal model (1415 tensors, 52%)
- E4B is second largest (949 tensors, 37%)
- 12B is lightweight (17 tensors, 1%)
Vision details:
- 16 layers, 768 hidden, 12 attention heads, 12 KV heads
- Patch size 16, output 280 soft tokens
- Position embedding 10240, pooling kernel 3
Audio details:
- 12 layers, 1024 hidden, 8 attention heads
- Subsampling conv [128, 32], chunk size 12
- Output proj dims 1536
Corrected classification:
- Complete towers: E2B (largest), E4B (medium)
- Lightweight projection: 12B (smallest)
- Pure text: 31B, 26B series
Testing status:
- E2B Audio: ✅ Tested
- E2B Vision: ⚠️ NOT tested ← needs testing!
- 12B multimodal: ⚠️ NOT tested ← needs testing!
Impact: All 4 reports need updates (capabilities, complete, comparison, 12B correction)
|
2026-06-23 23:23:34 +08:00 |
|