MarkBase Admin 31427770b1 v2: Apply tokenizer UTF-8 fix + Engine writeFloats helper ...

- Tokenizer fix: collect <0xXX> bytes and decode as UTF-8
  (fixes Chinese/non-ASCII character decoding)
- BPETokenizer + HuggingFaceTokenizer: both updated
- Engine.swift: added writeFloats() utility method
- FloatWeights struct added to Layer.swift (bf16 support)
- attnQBits/KBits/VBits/OBits detection added to Model.swift
- bf16 layer weight support from commit 48c0347 cherry-picked

2026-07-05 13:41:48 +08:00

.gitea/workflows

v2: Fix build conflict and unit tests

2026-07-05 13:31:45 +08:00

Scripts

v2: Initial clean branch with unit tests + CI/CD pipeline

2026-07-05 13:29:25 +08:00

Sources

v2: Apply tokenizer UTF-8 fix + Engine writeFloats helper

2026-07-05 13:41:48 +08:00

Tests

v2: Fix build conflict and unit tests

2026-07-05 13:31:45 +08:00

.gitignore

v2: Initial clean branch with unit tests + CI/CD pipeline

2026-07-05 13:29:25 +08:00

Package.swift

v2: Initial clean branch with unit tests + CI/CD pipeline

2026-07-05 13:29:25 +08:00

S

Description

MarkBaseEngine - Swift Metal multimodal inference engine for Apple Silicon

1.4 MiB

Languages

Swift 79%

Metal 20.9%

Shell 0.1%