Posted 5 years, 3 months ago
Roles
Data Engineer Software Engineer - Data Infra Distributed Systems EngineerLocations
REMOTE US, NYC, BOSTON
Contacts
bryan.hughes@datadoghq.com
Description
Looking for engineers to work on realtime (Kafka + Kafka Connect + custom Go consumers) and batch systems (Spark on EMR + Dataproc + Luigi + Parquet + S3 and GCS) to process 100's of TBs daily - at times PB-scale per day. Engineers in our Data Infra team build and own all infrastructure required to transport, process and store data at scale. This team also owns the system that allows teams to schedule and execute their batch jobs on multiple cloud platforms in multiple regions. Help us build the high-throughput, low-latency systems that power our product. These systems ingest, store, analyze, and query tens of millions of events per second from companies all over the globe.
Similar Jobs
Create your own personalized Job Alert