warren/markbaseengine
1
0
Fork 0
Code Issues Pull Requests Actions 19 Packages Projects Releases Wiki Activity
Files
78257a947c0a5f1b19f5789037f4ce37509d5d0b
markbaseengine/Tests/MarkBaseTests
T
History
MarkBase Admin 78257a947c
CI / build-and-test (push) Has been cancelled
Details
analysis: 12B 3 NaN real root cause found (NOT config mismatch) 
BREAKTHROUGH DISCOVERY:
- ❌ Previous hypothesis: Config mismatch (num_kv_heads: 8 vs 2)
- ✅ Actual root cause: Special Token IDs have embedding issues

EXACT NaN LOCATIONS:
- Token ID 2 (BOS - Begin of Sequence): NaN
- Token ID 255999 (BOI - Begin of Image): NaN
- Token ID 256000 (BOA - Begin of Audio): NaN

Evidence from debug test: indices [2, 255999, 256000]
Config fix made NaN worse (3→12), restored original config

Only 3 out of 262K tokens affected (0.0011%)
Recommendation: Use E4B/E2B or avoid special tokens
2026-06-24 00:53:27 +08:00
..
TestData
Update code generation tests with improved sampling
2026-06-23 19:46:51 +08:00
12BArchitectureTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
12BConfigFixTest.swift
analysis: 12B 3 NaN real root cause found (NOT config mismatch)
2026-06-24 00:53:27 +08:00
31BForwardTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
A4BComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
A4BDiagnosticTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AllModels26BOnlyTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AllModelsFinalTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AllModelsTextTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AudioGPUTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AudioSeparateTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
AudioTowerLoadTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
BatchEmbeddingOptimizationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
BatchGenerationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
BatchKernelTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
BatchLayerProcessingTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
CleanMoETest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
CodeGenerationTest.swift
Update code generation tests with improved sampling
2026-06-23 19:46:51 +08:00
ComparisonReporter.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
CompleteModelComparisonTest.swift
test: Complete model comparison test (6 models, Audio+Vision+Text)
2026-06-23 23:53:40 +08:00
CoreTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
CumulativeOptimizationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
DebugTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E2BAudioLoadTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4BAudioMultimodalTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4BMarkBaseTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4BSimpleInferenceTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4Bvs12BFullTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
E4BvsE2BComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
ExpertKernelParametersTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
FinalMoETest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12B31BTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BBufferTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BCompleteTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BForwardTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BGenerationTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BGeneratorTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BLoadingTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BMultimodalTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BOptimizationTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BPerformanceTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BTextGenerationTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
G12BTokenizerTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
GenerationNaNTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
InferenceSpeedTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
KernelFusionPerformanceTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
Layer0ComparisonTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
Layer4NaNTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
LongContextTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
LongTextLimitTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MetalKernelCompilationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MinimalTextLayerTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
Model12BVisionCheckTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
ModelComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
ModelLoadingOptimizationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
ModelScalesComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoE26BA4BTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoE26BStandardTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEDebugMinimalTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEDebugTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEExpertComputationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEForwardTests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEForwardWithFixedExpertTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEHiddenStateNaNDebugTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEHiddenStateSimpleTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEMinimalForwardTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoEPerformanceAnalysis.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoERouterOnlyTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MoETests.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MultimodalComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
MultimodalSequentialTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
NonProgrammingTest.swift
Add comprehensive code generation test framework
2026-06-23 19:36:26 +08:00
OptimizationPrototypeTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
OptimizationVerificationTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
OptimizedForwardTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
PerformanceAnalysisTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
RouterBitsCheckTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
RouterInputBufferSyncTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
RouterMatmulInputDebugTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
SimpleComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
StressTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
TextModelLoadTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
TwelveBNaNDebugTest.swift
analysis: 12B 3 NaN real root cause found (NOT config mismatch)
2026-06-24 00:53:27 +08:00
VisionComparisonTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
VisionQuickTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
VisionSeparateTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
VisionSummaryTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00
VisionTowerIndependentTest.swift
Initial commit: E4B-MarkBase model integration with passing tests
2026-06-23 18:12:35 +08:00