~hackernews | Bookmarks (5)

A few weeks ago, Figma published an article introducing their own sharding solution for PostgreSQL. The Figma engineering team was aware of, and evaluated, several existing options that could have made their database layer horizontally scalable. But still, they decided to build their own sharding solution from scrat...

The basic principle of the shuffle algorithm is to bucket the input data, where each bucket’s data can be processed independently and output results. This reduces the size of the hash table when aggregating data.Taking the group operator as an example, there are two implementation methods: sort group and hash group....

PostgreSQL isn’t just a simple relational database; it’s a data management framework with the potential to engulf the entire database realm. The trend of “Using Postgres for Everything” is no longer limited to a few elite teams but is becoming a mainstream best practice.In a 2016 database meetup, I argued that a sig...

Photo by Pawel Czerwinski on UnsplashIn the realm of distributed systems, database replication is indispensable, ensuring data durability, high availability, and system scalability. This exploration delves into why replication is pivotal, various replication strategies, and their impact on system performance and con...

Video analytics is used by millions of Vimeo users, ranging from individual content creators to large enterprises, facilitating in-depth insights into viewing patterns for hundreds of millions of videos. With real-time data spanning any desired time frame, our analytical platform beautifully handles over a billion v...