 MarkBase Admin
|
777626c5a7
|
fix: Correct 12B model multimodal capabilities
CI / build-and-test (push) Has been cancelled
CRITICAL CORRECTION:
- ❌ Previous reports incorrectly stated 12B as 'pure text model'
- ✅ 12B HAS both Audio + Vision capabilities (verified via config.json)
- Audio: 3 tensors (embedding projection, hidden=640)
- Vision: 14 tensors (embedding projection, hidden=3840)
- Audio samples per token: 640, sampling rate: 16000 Hz
- Vision patch size: 16, num soft tokens: 280, image: 224×224
Key difference from E4B:
- E4B: Independent towers (12-layer Audio, 16-layer Vision)
- 12B: Unified projection architecture (lightweight embedding)
Testing status:
- E4B Audio Tower: ✅ Fully tested (0 NaN)
- 12B multimodal: ⚠️ Not tested yet (only text tested)
Corrected classification:
- Both E4B and 12B support Audio+Vision
- E4B for deep feature extraction (tower architecture)
- 12B for lightweight multimodal integration (projection)
Impact: 3 reports need updates (E4B_vs_12B, complete_model, capabilities)
|
2026-06-23 23:10:17 +08:00 |
|