Talk type: Talk

Processing Data Lake with Node.js in serverless architecture

  • Talk in Russian
Presentation pdf

We'll discuss processing of data lake with cloud AWS Lambda functions on Node.js, from choosing cloud architecture patterns to deep diving into optimization of lambda functions on Node.js. We will identify and use the strengths of Node.js to accelerate data processing. We'll see how to increase throughput by scaling up to 7000 instances of lambda functions and services we use (streams, queues, and databases), tuning and optimizing lambda functions on Node.js, and choosing the best possible data communication protocols. We'll explore special aspects of profiling functions, logging, and monitoring in production cloud infrastructure.

  • #architecture
  • #aws
  • #casestudy
  • #node.js

Speakers

Talks