Overview

Nami is a Serverless framework for consuming Webhooks at scale. When events occur in batches, consumers can become overwhelmed by a deluge of webhook traffic resulting in a few thousand requests per second hitting their API endpoints. With a traditional architecture, this data can be handled by deploying server side logic across a cluster of always-on servers. However, given the lack of dynamic scaling properties with on demand traffic, it can result in either poor or inefficient use of resources. The Nami framework stands up a system that can consume bursty webhooks traffic using AWS Lambda Functions as a Service (FaaS). It leverages the dynamic scaling capability of Lambda compute containers to match the flow of incoming data. Nami then throttles the flow using an SQS queue as message broker to then send the data to a docker containerised MongoDB data store running on an EC2 instance.