LAB NOTEBOOK No. 01 · PROJECT · INDIA — UTC+5:30Code · repositoryDaily log · in progress
Code · repository · Daily log · in progress

AGI_Research

⑂ Code · repository·Public lab notebook — committed daily since July 2026. Linear algebra, calculus and probability from axioms → neural net
View code on GitHub ↗ ← Back to archive

A public lab notebook committed daily since 1 July 2026 — 548 days to 31 Dec 2027. I derive everything by hand: linear algebra, calculus and probability from axioms, then neural nets, backprop, optimisers from SGD to Adam in pure NumPy, now CNNs and Transformers.

Each day is a notebook with math, code and reflection — no autograd, no shortcuts. The repo is the research log; the portfolio shows the distilled logs. Follow along as the bench grows.

Highlights

  • Linear algebra, calculus and probability from axioms
  • Forward and backward pass in pure NumPy
  • Backpropagation derived by hand — no autograd
  • Optimisers from SGD to Adam, built step by step
  • Now: CNNs, attention, Transformers
backprop ✓ NumPy CNNs Transformers PyTorch daily commits
Jupyter Notebook 86.4% · Python 13.6%
Days
40+
Notebooks
40+
Commits
150+
FAQ — AGI_Research
How often do you commit?tap ↕

Daily since 1 July 2026 — the mission is 548 days to 31 Dec 2027. Each day is a notebook.

Do you use PyTorch or pure NumPy?tap ↕

Both — I first build everything in pure NumPy by hand (backprop, Adam, CNN), then show the PyTorch version for comparison.

Can I follow along locally?tap ↕

Yes — clone hariomlohardev/AGI_Research, open any notebook in Jupyter, and run top to bottom. No API keys needed.

Related logs
2026-08-10 · 2 min
Day 040 — Multi-Head, Residual & Layernorm by Hand
Stacked 4-head attention + residual + layernorm forward/backward in NumPy — same mask, new choreography, grads checked at 1e-4.
Read →
2026-08-08 · 1 min
Day 039 — Attention by Hand
Derived scaled dot-product attention forward/backward in NumPy — QKᵀ, causal mask, softmax, and the gradient through it.
Read →
2026-08-01 · 1 min
Day 032 — CNN from Scratch, No Autograd
Built 2D convolution forward + backward in pure NumPy — im2col, stride, padding, and the gradient that makes it learn.
Read →
View code on GitHub ↗ ← All projects GitHub ↗