Bookmarks (185) clear filters

April 12, 2021 • 44 minutes On this episode, Jeremy chats with Alexandra Abbas about why we need MLOps, how teams productionize workflows and deploy models, the challenges for serverless machine learning use cases, and much more. Watch this episode on YouTube: Alexandra Abbas is a Google Cloud Certified Data Enginee...

We are building a data hub within AWS where we obviously use several S3 buckets. As the whole data hub is built upon serverless technologies we also use several Lambdas and sometimes they get triggered when new files arrive in one of our S3 buckets.Bucket notificationsAWS offers S3 bucket notifications for sending e...

6 days ago·8 min readPhoto by Markus Spiske on UnsplashBuilding your first end to end data orchestration and data pipeline could be overwhelming. There are numerous tech stacks and open source tools one can use, so it could be hard to decide, learn and build one fully functional production pipeline.Fortunately, AWS ...

Hello everyone, Recently I had the opportunity to work on a music application, where I have developed a REST API to download the audio file given a video ID of the source youtube video. In this blog, I will be covering my experience while building the project like common pitfalls, design decisions I had to undergo w...

April 5, 2021 • 39 minutes On this episode, Jeremy chats with Jason McGee about IBM's approach to serverless, the recent GA of IBM Cloud Code Engine and how it opens up even more serverless use cases, and IBM's view of a serverless future. Watch this episode on YouTube: Jason McGee, IBM Fellow, is VP and CTO at IBM ...

Inspired by Andrew Brown who outlined a course that he shared on Twitter and by an ongoing reflection on my own experiences with cloud and serverless adoption at the company I work for, I decided to share a little about my perceptions on the current shift in landscape and what it means to be a developer in this cont...

March 29, 2021 • 51 minutes On this episode, Jeremy chats with Dr. Denis Bauer about how serverless is being used for genome editing and high-performance computing in the scientific community, how it helped with Australia's COVID response, and how the technology can be used to collaborate with others around the worl...

API Usage TrackerAWS EventBus offers out-of-the-box integration with multiple AWS Services.Supported EventBridge Targets https://docs.aws.amazon.com/eventbridge/latest/userguide/eventbridge-targets.htmlThe event bus in us-east-1(N.Virginia) supports 10K PutEvents per second. A bus can have at max 300 Rules . A rule ...

Last week I was giving an introductory class to my company's technical support team on a new product we've been building. The new product is completely different than anything else we've built before: tech stack, programming languages, methods of deployment, you name it - it's different. As I was walking through the...

Converting formats on demand using S3 Object LambdaFetching and transforming data from S3 using AWS Lambda is one of the most common serverless patterns. The new S3 Object Lambda feature allows a Lambda to be invoked on demand as part of the lifecycle of S3 GetObject. This opens up a new set of possibilities. Object...

March 22, 2021 • 57 minutes On this episode, Jeremy chats with Aaron Turner about the use cases for WebAssembly, how WASI makes serverless compute at the edge even more portable and powerful, some popular WASM toolchains, and what the future of this technology looks like. Watch this episode on YouTube: Aaron Turner ...

5 days ago·5 min readReasoning about AWS costs using the AWS Cost Explorer and the AWS CLIPhoto by StellrWeb on Unsplash🚂 I’ll walk you through a train of thought. Along the way, you’ll see how I discover what aspects of CloudWatch and API Gateway are generating the most charges in the example AWS account, and how I...

So, you have a genuinely valid reason, you’re interested in a short-term fix, or you only started reading from here: how can you enable and disable an event source mapping on a schedule?Let’s look at an “only do work at night” scenario where we want our event source mapping to be enabled every night between 01:00 an...

Mar 11·3 min readFor a long time, I was looking for a serverless full-text search solution. Of course, there are managed solutions for this, like Elastic Cloud or Amazon Elasticsearch Service. But all these solutions have a fixed cost and do not scale automatically.I also saw a couple of attempts to run Apache Lucen...

How a Confusing UX Cost a Company $7K in Extra S3 Charges — One person’s sour experience with a confusingly explained feature around editing the storage class of files in S3. (And yet another reminder to set up billing alerts on your AWS account to catch such things quickly.)

Unzip Large Files in AWS S3 using Lambda and Node.js — Unzipper is a helpful package here as its streaming approach promises a low memory footprint even when decompressing large files.

▶  Serverless in a DevOps World with Sarjeel Yusuf — Sarjeel Yusuf is a project manager at Atlassian and spoke to Jeremy Daly about the value of devops in modern development teams and how serverless makes app deployment and general devops automation better and faster.

How to Host a Serverless Static Website on AWS with API Gateway — Using API Gateway to serve a static website from S3 can be useful when you have special requirements that Cloudfront cannot fulfil alone. Be warned, this could get pricey at scale.