 MarkBase Admin
|
a8689741f1
|
Add E4B vs 12B comprehensive comparison report
CI / build-and-test (push) Has been cancelled
Test Results:
- E4B: 42 layers, 2560 hidden, multimodal (Audio+Vision)
- 12B: 48 layers, 3840 hidden, pure text
- Both models: 0 NaN, stable embeddings
Performance:
- E4B: 42.8 tok/s (fastest, KV sharing)
- 12B: ~26 tok/s (larger model)
Recommendations:
- Multimodal tasks → E4B-MarkBase
- Text speed → E4B-MarkBase
- Text capacity → 12B Model
- Code generation → Need specialized model
Tests: Config load, forward pass, embeddings, NaN check, comparison
|
2026-06-23 20:04:46 +08:00 |
|