Such a good write up . Having explored a little bit of sqlite internals for a codecrafters challenge i was mildly happy i could follow along what was happening .

I love Pi . I have been building an agent using its agent harness https://github.com/earendil-works/pi/tree/main/packages/agen... . I love the simplicity .

Hey ! Great work , I wanted to try something like this as well to begin my journey into games and computer graphics . I would love to know what resources you used to learn.

The greatest resource I've found on the internet is the Ray Tracing in One Weekend series. (https://raytracing.github.io/) You can start there and go pretty far. Also you can mix random papers you'll find and eventually just testing and experimenting yourself.

This is spot on ! Most of the work we really do is pure boilerplate and should be automated. While there are instances of interesting work those are far and few in between . The most recent instance of "how the hell did they do that?" for me was duckdb.

Yes , I had so much fun implementing sqlite from the scratch . Incidentially it was right about the time I started trying claude code. I did the last challenge in sqlite to scan with an index using claude code and I was blown away. It actually solved it.

I am working on trentdb . An in process single node database query engine inspired heavily by duckdb . Its primarily for me to understand databases in depth . Its completely written by codex and in java . Why Java? Its the language I am most familiar with . I just finished adding support for running all TPC-H queries.

Its sitting at the top in clickbench .Pretty cool https://benchmark.clickhouse.com/#system=-&type=-&machine=-c...

Wow! Now I got interested on reading the paper, thanks

It really is a SeriousDB

44% is not marginal. "Marginal" is what perceived by seller and buyer as negligible and it tops at 5%.

its marginal compared to promised 10x improvement.

I am Working my way through https://app.codecrafters.io/courses/sqlite/overview . Its been so much fun .

I am working through https://app.codecrafters.io/courses/sqlite/overview . its been pretty good.

Excellent article . Few more that come to mind

Think real carefully about breaking transactionality unless absolutely needed . It has been the single source of most problems i have seen over the past few years.

Keeping 2 different systems in sync is really hard do not do it if you dont have a real need to do it.

Monoliths are really good , there is absolutely no need to run microservices or any services for that matter other than a single monolith. The place where i work at is generating billions of dollars with a single monolith.Having said that there will come a time when some logic has to go to a different services , If you get there your company is really really successful :) .

Relational databases can do a lot more than what you think and they can absolutely scale well.