~betterdevlink | Issues #264 Aug 26, 2024 (25)

Realtime mouse pointer In collabortion app you will usually see the cursor of all the user moving around. How would we implement that? At scale. Canvas engineering share with us here. Some good find such as using a Binary serialization instead of JSON to reduce CPU load on backend

Postgres as a search engine Build a retrieval system with semantic, full-text, and fuzzy search in Postgres to be used as a backbone in RAG pipelines. We will do all: full text search, semantic search, fuzzy search with Postgres

What’s Really Going On in Machine Learning? Some Minimal Model It’s surprising how little is known about the foundations of machine learning. Yes, from an engineering point of view, an immense amount has been figured out about how to build neural nets that do all kinds of impressive and sometimes almost magical things. But at a fundamental level we still don’t really know why...

Linux Pipes are Slow Some programs use a particular system call “vmsplice” to move data faster through a pipe. When not using vmsplice, Linux pipes are slower than what I would have expected. Since we cannot always use it, lets see exactly why that was, and whether it could be improved.

Continuous reinvention: A brief history of block storage at AWS Marc Olson has been part of the team shaping Elastic Block Store (EBS) for over a decade. In this post, Marc provides a fascinating insider’s perspective on the journey of EBS. He shares hard-won lessons in areas such as queueing theory, the importance of comprehensive instrumentation, and the value of incrementalism versus radical changes....

Ethernet History Deepdive – Why Do We Have Different Frame Types? Take us into the history of Ethernet to see why things happened the way they did. It will also significantly enhance your network knowledge.

Build your own SQLite, Part 1: Listing tables As developers, we use databases all the time. But how do they work? In this series, we’ll try to answer that question by building our own SQLite-compatible database from scratch.Source code examples will be provided in Rust, but you are encouraged to follow along using your language of choice, as we won’t be relying on many...

Advanced Monitoring with AI and Prometheus: Detecting and Mitigating Memory Leaks Detect memory by just looking at growth rate of memory is simple. What if we train a model of leak pattern, and apply it to detect it sooner and more efficent?

How Postgres stores data on disk – this one's a page turner databases are basically magic, and SQL is the arcane tongue that allows you to channel that magic. In fact, it’s easy to think of databases like a black box where you make sure your tables are indexed sensibly and your queries aren’t doing anything silly, and the rest just happens. But at...

pie Enjoy a slice! A utility library for dealing with slices and maps that focuses on type safety and performance.

ruroco a tool that lets you execute commands on a server by sending UDP packets. The commands are configured on the server side, so the client does not define what is going to be executed, it only picks from existing commands.

chroma.js JavaScript library for all kinds of color manipulations. Working with color is really fun because it invole a lot of matrix manipulation and some cool tip.

vega a visualization grammar, a declarative language for creating, saving, and sharing interactive visualization designs. With Vega, you can describe the visual appearance and interactive behavior of a visualization in a JSON format, and generate web-based views using Canvas or SVG.

pg_duckdb: DuckDB + Postgres extension DuckDB-powered Postgres for high performance apps & analytics. Check out the introduction post