Explore

We were building a startup that measured marketing effectivness via a statistical attribution model. For this to work we had to collect a ton of online user behavior. Every click, every field input, every action. Data was stored in postgres and end users, via our UI, ran dashboards and reports that crunched the abov...

In this article, we’ll be taking a look at how to run a GPU-accelerated open-source Large Language Model (LLM) inference workload using Elastic Kubernetes Service (EKS). Perhaps the most buzzwords I’ve ever unironically strung together in a single sentence. Wondering what inference means? It’s the fancy term for pro...