I really enjoyed this write-up, and while I have been reading about and using LLMs for a year now, this still had a lot of new info for me. I really liked the description of what the info vector associated with each word is used for.
It's interesting, it runs out of hydrogen propellant way before it runs out of energy, which is why they want to figure out a way to refuel it.
Pretty cool how Sacramento is actually building housing, it would be nice if we were seeing this sort of increase in production of apartments in the Bay Area.