Apify

Apify builds software technology and infrastructure that helps small startups and the world’s biggest companies leverage the full potential of the Web—the largest source of information ever created in the history of humankind. To help achieve this, we've developed a serverless cloud platform and tools focused on web scraping and automation. Apify runs an infrastructure that processes over a billion web pages every month. We use: Node.js, MongoDB, AWS (EC2, S3, DynamoDB, SQS, ECS, Lambda, ECR, EKS ...), Linux, Kubernetes, ReactJS, Next.js, headless Chrome / Puppeteer, ...