b.BEKHRUZ SULEYMAN

Independent researcher & engineer · Uzbekistan

Bekhruz
Suleyman.

I work on language models, systems, compilers, and experimental software. Currently researching Alethic and Sin-Gated Control Attention.

View researchView projects
Current research / 01active

Alethic

Separating attention retrieval from residual control.

C = (WH + b) ⊙ [α ⊙ sin(A)]
~1BParameter target
8,240Context target / tokens
SGCA · GQA · RMSNormResearch overview
Currently
Alethic Phase IControlled scale-upactive
SGCASinusoidal control pathexperimental
Training infrastructureTokenization & dataset packingbuilding

01Selected research

All research
R.01active

Alethic

Language-model architecture research, from controlled small-model experiments to a planned ~1B Phase I.

~1B target
R.02experimental

SGCA

Sin-Gated Control Attention: separating attention retrieval from learned residual control.

Architecture research
R.03completed

SinGatedLM

Parameter-matched small language-model experiments with a sinusoidal attention gate.

~64K / ~1M

02Selected projects

All projects
01

AiOS

experimental

Experimental x86_64 operating-system work, from kernel bring-up to rootfs integration.

C · Assembly · x86_64 · Limine
02

Flang-Lite

building

A language with a compiler frontend, NASM code generation, and a bytecode virtual machine.

Lexer · AST · NASM · Bytecode VM
03

ArzoMarket

building

Commerce search and aggregation for Uzbek and regional product discovery.

FastAPI · React · TypeScript · MySQL · Playwright
04

Mentis

experimental

An experimental coding environment for AI-assisted learning.

Next.js · Monaco · Python · Go

03Latest writing

All writing

Why separate retrieval from control?

Research · sgca · research
2 min read

What the small SinGated experiments actually show

Experiments · experiments · research
2 min read

Planning a 1B language-model experiment independently

Training · alethic · training
2 min read

Building dataset pipelines under free compute

Infrastructure · datasets · training
2 min read
How I work

Understand the mechanism. Build the smallest real version. Measure what happens. Find what is wrong. Iterate.

More about me