Apache Spark jobs
Recent jobs where this technology appears in the post.
-
Climate Friendly
Senior Data Engineer
Posted 2 weeks ago
We are looking for a Senior Data Engineer to lead the delivery of scalable, high-quality data pipelines that support carbon, nature, and natural capital projects. This is a hands-on, technical leadership role where you will own pipeline delivery, shape data p…
Roles
Tech stack
Location
Sydney, Melbourne, Brisbane
Work setup
full-time · Hybrid
-
Espresso AI
Staff Infra Engineer
Posted 2 weeks, 1 day ago
We’re using LLMs to build neural optimizers, neural scheduling systems, and neural workload tuners. Today we use ML to make data warehouses and spark jobs more efficient. We’re hiring staff ML engineers to train models that can understand how much compute a j…
Tech stack
Location
Brooklyn, San Francisco
Work setup
full-time · Onsite (Brooklyn or San Francisco listed; no remote details provided).
Compensation
Full time (no salary details provided).
-
Perry Street Software
Senior Ruby Developer
Posted 2 weeks, 2 days ago
As a Senior DevOps Engineer, you will help run the cloud infrastructure that powers our Ruby API for our family of LGBTQ+ mobile dating apps. The position is 40 hours per week and ongoing/full-time. The company also recently launched the first architectural l…
Tech stack
Location
Remote (EU/LatAm/North America)
Work setup
full-time · Remote across EU/LatAm/North America; includes initial in-person Zoom interviews.
Compensation
Full-time role (40 hours per week). No salary figures provided.
-
Virtasant
Senior Data Engineer
Posted 2 weeks, 3 days ago
Virtasant is both a cloud optimization company and a staffing agency for clients. You can own and scale a modern healthcare data platform by building core services, automation, and observability that power real-world patient and provider outcomes. Role is ful…
Tech stack
data quality Amazon Web data onboarding data catalog dbt Delta Lake SSO quality metrics Streaming Snowflake data contracts Amazon Redshift Dagster Kafka schema governance Python data portals Product Distributed Compute Apache Spark S3-based table formats data observability internal platforms health AWS Healthcare data metadata management schema tracking Continuous Deployment quality monitoring OAuth2 FHIR Google BigQuery Data Validation self Continuous Integration Prefect SQL data migration CI/CD Apache Airflow orchestration Docker Apache Iceberg DevOps Metadata data lineage Redshift Hudi data engineering JWT Iceberg x12 Apache Hudi schema evolution BigQueryLocation
USA
Work setup
contractor · 100% remote (within contiguous USA).
Compensation
Long-term, no-end-date 1099 contract.
-
BIT Capital
Head of Engineering
Posted 2 weeks, 3 days ago
Looking for the key engineering leader to build and scale infrastructure and data platforms for a Berlin asset management fund. Betting big on AI to drive investment returns and build the best infrastructure to support high alpha targets. Design large-scale d…
Roles
Tech stack
Location
Berlin, Germany
Work setup
full-time · ONSITE (2 days/week)
Compensation
Competitive comp; relocation & visa support.
Benefits
Competitive comp, Relocation & visa support, Stellar team
-
Praia Health Inc.
Source: We Work Remotely
Staff Software Engineer - Data Infrastructure
Posted 1 month, 1 week ago
Praia is seeking a Staff Software Engineer to serve as a technical anchor and architect for its core consumer experience platform. The role involves end-to-end architectural ownership spanning high-performance Java services, Databricks ETL pipelines, and ente…
Tech stack
Location
Anywhere in the World
Compensation
Competitive salary and performance-based bonuses. Full medical, dental, and vision benefits. Company paid life insurance, company paid short-term & long-term disability. 401K savings plans with company matching. Employee wellness programs and resources. Flexible PTO.