warren/markbaseengine
1
0
Fork 0
Code Issues Pull Requests Actions 18 Packages Projects Releases Wiki Activity
Files
285dc4bce400b4406e673f3b0c16e88d54da8372
markbaseengine/Tests/MarkBaseTests
T
History
MarkBase Admin 285dc4bce4
CI / build-and-test (push) Has been cancelled
Details
26B-A4B实际使用测试：发现数值溢出bug（不适合实际使用） 
=== 实际测试结果 ===
Token 2: Max logit = inf ⚠️
连续生成5步：全部inf ⚠️
position > 2：大量NaN爆炸 ⚠️

=== 与26B-Standard对比 ===
26B-A4B: inf，生成Token 49777（错误）
26B-Standard: 141.38966，生成Token 2（正常）

=== 发现两个问题 ===
1. Token ID屏蔽（设计特性）✅
2. 数值溢出（inf）（真正的bug）⚠️ ⭐⭐⭐

=== 最终结论 ===
26B-A4B: ⚠️ 不适合实际使用
26B-Standard: ✅ 完美可用

=== 推荐强度 ===
使用26B-Standard代替：⭐⭐⭐⭐⭐⭐⭐⭐⭐⭐

原因：
1. 数值溢出导致生成错误token
2. 后续生成大量NaN
3. 生成序列质量极差
4. 无法用于实际inference

=== 技术成果 ===
✅ bits=8量化完整支持（Swift + Metal）
✅ 发现Token ID屏蔽机制（设计特性）
⚠️ 发现数值溢出bug（不适合使用）

配置对比：
26B-A4B: group_size=64, softcapping=30.0
26B-Standard: group_size=32（触发scaling）

测试文件：
TwentySixBA4BRealUsageTest.swift
- testActualGeneration（发现inf）
- testCompareGenerationQuality（对比）
- testMultiTurnGeneration（NaN爆炸）

状态：不适合实际使用
推荐：使用26B-Standard代替 ⭐⭐⭐⭐⭐⭐⭐⭐⭐⭐
2026-06-24 04:41:41 +08:00
..
TestData
Update code generation tests with improved sampling
2026-06-23 19:46:51 +08:00
12BArchitectureTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
12BConfigFixTest.swift
analysis: 12B 3 NaN real root cause found (NOT config mismatch)
2026-06-24 00:53:27 +08:00
31BForwardTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
A4BComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
A4BDiagnosticTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AllModels26BOnlyTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AllModelsFinalTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AllModelsTextTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AudioGPUTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AudioSeparateTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AudioTowerLoadTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
BatchEmbeddingOptimizationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
BatchGenerationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
BatchKernelTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
BatchLayerProcessingTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
CleanMoETest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
CodeGenerationTest.swift
Update code generation tests with improved sampling
2026-06-23 19:46:51 +08:00
ComparisonReporter.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
CompleteModelComparisonTest.swift
test: Complete model comparison test (6 models, Audio+Vision+Text)
2026-06-23 23:53:40 +08:00
CoreTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
CumulativeOptimizationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
DebugTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E2BAudioLoadTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4BAudioMultimodalTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4BMarkBaseTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4BSimpleInferenceTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4Bvs12BFullTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4BvsE2BComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
ExpertKernelParametersTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
FinalMoETest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12B31BTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BBufferTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BCompleteTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BForwardTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BGenerationTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BGeneratorTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BLoadingTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BMultimodalTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BOptimizationTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BPerformanceTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BTextGenerationTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BTokenizerTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
GenerationNaNTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
InferenceSpeedTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
KernelFusionPerformanceTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
Layer0ComparisonTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
Layer4NaNTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
LongContextTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
LongTextLimitTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MetalKernelCompilationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MinimalTextLayerTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
Model12BVisionCheckTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
ModelComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
ModelLoadingOptimizationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
ModelScalesComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoE26BA4BTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoE26BStandardTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEDebugMinimalTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEDebugTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEExpertComputationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEForwardTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEForwardWithFixedExpertTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEHiddenStateNaNDebugTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEHiddenStateSimpleTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEMinimalForwardTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEPerformanceAnalysis.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoERouterOnlyTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoETests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MultimodalComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MultimodalSequentialTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
NonProgrammingTest.swift
Add comprehensive code generation test framework
2026-06-23 19:36:26 +08:00
OptimizationPrototypeTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
OptimizationVerificationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
OptimizedForwardTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
PerformanceAnalysisTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
RouterBitsCheckTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
RouterInputBufferSyncTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
RouterMatmulInputDebugTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
SimpleComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
StressTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
TextModelLoadTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
TwelveBNaNDebugTest.swift
analysis: 12B 3 NaN real root cause found (NOT config mismatch)
2026-06-24 00:53:27 +08:00
TwelveBSpecialTokenTest.swift
breakthrough: 12B 3 NaN ultimate truth - DESIGN FEATURE, NOT BUG
2026-06-24 01:11:56 +08:00
TwentySixBA4BDeepDebugTest.swift
CRITICAL: 26B-A4B NaN真相 - 真实BUG而非设计特性
2026-06-24 01:44:39 +08:00
TwentySixBA4BLayerByLayerDebugTest.swift
26B-A4B最终真相：Token ID Logits屏蔽机制（设计特性）
2026-06-24 04:18:27 +08:00
TwentySixBA4BNaNLocationTest.swift
CRITICAL: 26B-A4B NaN真相 - 真实BUG而非设计特性
2026-06-24 01:44:39 +08:00
TwentySixBA4BRealUsageTest.swift
26B-A4B实际使用测试：发现数值溢出bug（不适合实际使用）
2026-06-24 04:41:41 +08:00
VisionComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
VisionQuickTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
VisionSeparateTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
VisionSummaryTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
VisionTowerIndependentTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00