Mechanistic Interpretability

Posts in the Mechanistic Interpretability category

AI

Transformer Architecture

Published on May 15, 2026 at 09:32 PM

It was interesting and beautiful. From input strings to numbers by a process called embedding , before embedding the prompt is tokenized. during embedding it embeds the string as well as its...

Read more →
AI

Mechanistic Interpretability - Day 1

Published on May 13, 2026 at 10:16 PM

I did complete the prerequisite course for my day 1, I'm fully commited to it. So I'm just putting my learner's log here. I learnt a lot of einops, and really liked playing around with, It was so...

Read more →