View on Hacker News
Roles
Compensation
USD 156000 - 196000
Full-time role with salary range $156k-$196k (USD).
- Salary period
- yearly
- Location basis
- unclear
Tech stack
Required
Nice to have
Location
San Francisco, United States
Work setup
- Employment
- full-time
- Level
- Senior
- Remote policy
- Hybrid (in San Francisco)
- Remote scope
- unclear
- Travel
- unclear
- Visa
- unclear
- Authorization
- unclear
- Clearance
- unclear
Role details
Responsibilities
- Build out the city’s central Snowflake platform to power SF’s analytics, open data, and ML efforts
- Work on data infrastructure including CI/CD and Terraform
- Build data pipelines using ADF and dbt and Python
- Perform platform engineering and administration for Snowflake
- Manage Snowflake data warehouse, including access control, security policies, resource monitoring, performance tuning, and cost optimization.
- Administer platform with a focus on data democratization and accessibility, while protecting privacy and security.
- Build and maintain scalable and resilient pipelines to ingest and structure data from diverse sources.
- Design infrastructure to support both streaming and batch processes, and both structured and unstructured data sources.
- Use Terraform to define, deploy, and manage data infrastructure, ensuring pipelines are reproducible, version-controlled, and production-ready.
- Champion and implement best practices for documentation, data modeling, warehouse architecture, SQL optimization, and testing.
- Think creatively to find new ways to improve the data platform's capabilities and efficiency.
- Provide guidance to department partners on data engineering best practices.
- Work closely with data scientists, analysts, product managers, software engineers, and nontechnical stakeholders in diverse domains to understand data requirements and build solutions that meet their needs.
- Proactively monitor the health of the data platform and pipelines, troubleshoot issues, and ensure high standards of data quality and availability.
Requirements
- Strong SQL and Python skills
- Deep data modeling experience
- Data infrastructure and devops experience (Terraform, Actions)
- dbt and Snowflake experience (big plus)
- Be comfortable using a terminal
Application
Apply here: https://careers.sf.gov/role/?id=3743990013401756
- Deadline
- June 21, 2026 at 11:59pm PST
- Portfolio
- not required
- GitHub
- not required
- Cover letter
- unclear
- Apply flow
- external
- Canonical URL
- https://careers.sf.gov/role/?id=3743990013401756
Company context
Power SF’s analytics, open data, and ML efforts through a central Snowflake platform
- Product
- City analytics, open data, and ML efforts via a central Snowflake platform
- HQ
- City & County of San Francisco
Description
DataSF is looking for a Senior Data Engineer to help build the city's central Snowflake platform powering most of SF's analytics, open data, and ML efforts. This role mixes data infrastructure (CI/CD, Terraform), building pipelines (ADF, dbt, Python), and platform engineering and administration (Snowflake).
Similar jobs
-
Loading similar jobs...