I love mind mapping. It helps arrange and rearrange new information so a brief glance is enough to spur the memory of the content. Chapter 2 goes over tooling and setting up the books companion repository. Chapter 3 goes over the Data Engineering workflow with emphasis on chapter 5
All posts in LLM
Django and pgvector for semantic search
Goal: Semantic Search Setup pgvector You have a model with a field you want to make semantically searchable. Installation comes from: https://github.com/pgvector/pgvector-python Step: install pgvector on your machine Step: create a migration to activate Step: add a VectorField to your model Step: make migrations and migrate Setup sentence transformers for embeddings We will use the…
Can ChatGPT do math? NO! But why?
ChatGPT can “kind of” do math, but with limited precision. 1+1, 2+2, it’s great at these additions. Here’s GPT-3.5 Here’s GPT-4 But why? Interestingly, GPT knows the way it was trained and the inherent limitations of using a language model to produce accurate arithmetic.
GPT from scratch: Karpathy
Andrej Karpathy has an incredible video on building GPT from scratch. Here are cartoon notes covering the contents: