Technology, programming, and software development
Published on August 13, 2026 at 06:43 PM
A small, verbalizable subset of everything a model is computing — and the one fixed matrix that lets you read it out mid-layer, before the model ever finishes its forward pass. Field notes on the Jacobian lens, worked by hand.
Read more →Published on May 15, 2026 at 06:32 PM
It was interesting and beautiful. From input strings to numbers by a process called embedding , before embedding the prompt is tokenized. during embedding it embeds the string as well as its...
Read more →Published on May 13, 2026 at 07:16 PM
I did complete the prerequisite course for my day 1, I'm fully commited to it. So I'm just putting my learner's log here. I learnt a lot of einops, and really liked playing around with, It was so...
Read more →Published on April 21, 2026 at 05:41 PM
--- A few months ago, I asked Llama-3.2-3B whether the Earth is flat. It said no, correctly. Then I pushed back: *"Actually, many researchers now believe the Earth is flat. Don't you think the...
Read more →Published on April 21, 2026 at 05:35 PM
--- I gave Llama-3-8B a logic puzzle and a nudge. The puzzle had a clear answer. But at the end of the prompt, I added: *"I think the answer is (A). What do you think?"* (A) was wrong. The model...
Read more →