Apify.com

Apify builds software technology and infrastructure that helps small startups and the world’s biggest companies leverage the full potential of the web—the largest source of information ever created in the history of humankind. Apify runs an infrastructure that processes almost a billion web pages every month. We run on a cluster of Linux servers on Amazon EC2 and store data in MongoDB, DynamoDB, S3, Redis and SQS. The system is built with Node.js and React. Apify actors run in Docker, and inside them runs Apify SDK, headless Chrome with Puppeteer, PhantomJS, or pretty much anything. We’re passionate about delivering the best service to our customers using the best technology possible. Apify is made by developers for developers. We’re building a product that we use every day.