2 Commits

Author	SHA1	Message	Date
MarkBase Admin	fdeae9a540	Update code generation tests with improved sampling ... - Implemented top-k sampling (k=50, temperature=0.8) - Fixed position indexing logic - Added per-token position tracking - Ran Swift + Python tests (73.5s total) - Results: 0 NaN, stable embeddings, but poor code quality - Issue: Model generates invalid/multilingual characters - Conclusion: E4B-MarkBase not optimized for code generation - Recommendation: Use specialized code model for programming tasks - Test framework: Production-ready, multi-language support	2026-06-23 19:46:51 +08:00
MarkBase Admin	80a78ec554	Add comprehensive code generation test framework ... - Created test infrastructure for 240 tests (57 implemented) - Programming tests: Swift, Python, C++, JavaScript, Rust (40 tests) - Non-programming tests: Text, Math, Logic, Knowledge, Vision, Audio (17 tests) - Installed Rust compiler (rustc 1.96.0) - Test framework builds successfully - Sample test executed (generation quality needs improvement) - Identified issues: greedy sampling, position indexing, code syntax	2026-06-23 19:36:26 +08:00