Bookmarks (1) clear filters

Scaling up a Serverless Web Crawler with Step Functions — Creating your own custom search engine can be both fun and useful (we have our own which helps us produce these newsletters!) but how could you approach crawling and indexing Web content in a serverless way? Here’s the basics of breaking down the main crawling process and how AWS Step Functions can orchestrate things. (Amazon...