Sultaan research log Engineering notes on Sultaan, a private research project. The repository is private; updates are published here. https://sultaan.io/ 2026-10-05T00:00:00Z Divyaprakash Jhahttps://divyaprakash.si/ This notebook goes up tag:sultaan.io,2026-10-05:log 2026-10-05T00:00:00Z sultaan.io starts publishing engineering notes, because the repository stays private. Portfolio review tag:sultaan.io,2026-10-01:log 2026-10-01T00:00:00Z Sultaan is confirmed as a research track, not a launch dependency. Ten engineering sessions are planned, and LoRA fine-tuning of an open model is named the practical route to a sovereign model. First contact: a new tier, a supervisor and a recorded run tag:sultaan.io,2026-07-16:log 2026-07-16T00:00:00Z ADR 0026 adds a roughly 33M first-contact tier, a streamed multi-source mixture, a hardware preflight, a streaming tokenizer trainer, a crash-safe overnight supervisor and a local text-corpus path. The same day, a 33.9M-parameter model trained on a 6 GB laptop GPU: loss fell from 9.78 to 3.89 over 20,000 steps on 500 Project Gutenberg books. That run is recorded only on an unmerged branch, and its checkpoint has not been located since. Training-run hardening tag:sultaan.io,2026-07-02:log 2026-07-02T00:00:00Z A training-health sentinel, atomic and promoted checkpoints, the tier gate, the provenance schema and the mixture bandit; trust tiers for the knowledge graph, typed memory facts and an agent circuit breaker (ADRs 0021 to 0025). Phase 3 begins tag:sultaan.io,2026-06-09:log 2026-06-09T00:00:00Z The pretraining stack is fixed: a from-scratch Llama-style decoder, FineWeb-Edu streaming, FSDP chosen for future multi-GPU tiers, bf16 and a cosine schedule (ADR 0016). Evaluation suite expanded tag:sultaan.io,2026-06-04:log 2026-06-04T00:00:00Z A TruthfulQA multiple-choice subset and a custom hallucination probe set join perplexity and MMLU (ADR 0013).