Jobs of the Week (US): Top 10 Data & AI Engineering Roles – Week of November 05, 2026

Curated weekly intelligence featuring the top 10 Data Engineering, Lakehouse Architecture, MLOps, and Applied AI roles across the United States with verified compensation ($ USD), core tech stacks, and enterprise use cases.

Share
Aurora exascale supercomputer computing environment at Argonne National Laboratory
Aurora exascale supercomputer computing environment at Argonne National Laboratory (Public Domain via Wikimedia Commons)
Aurora exascale supercomputer computing environment at Argonne National Laboratory
Aurora exascale supercomputer facility at Argonne National Laboratory (Public Domain via Wikimedia Commons)

The landscape of Tier-1 US tech hiring across Silicon Valley, New York City, Seattle, and nationwide remote has reached a definitive inflection point. Modern data engineering is no longer simply building reporting marts or orchestrating batch ETL; it has converged directly with foundation model pre-training pipelines, low-latency agentic execution runtimes, and exabyte-scale open lakehouse storage engines.

Over the preceding recruiting cycle, data and AI infrastructure hiring has consolidated around three primary architectural vectors:

  • Lakehouse Consolidation Around Open Table Formats: Universal adoption of Apache Iceberg and Delta Lake (governed via Unity Catalog and Polaris) has replaced fragmented analytical silos, serving as high-throughput ingestion engines for pre-training data and real-time feature retrieval.
  • Real-Time Stream-Table Processing: Batch pipelines are systematically being superseded by sub-second streaming fabrics powered by Apache Flink, Kafka, and RocksDB state backends, especially for mission-critical fraud, risk, and online inference features.
  • Agentic Memory & Tool Governance: Frontier engineering teams are architecting transactional governance layers, audit trails, and Model Context Protocol (MCP) integrations for autonomous enterprise agents.

Master Summary: Top 10 US Data & AI Roles of the Week

Rank Role & Company Arrangement Total Comp (USD $) Core Tech Stack Apply
1 Research Engineer, Pre-training Data
Anthropic
Hybrid (SF / Seattle) $550k – $850k+ Ray, Spark, Rust, PyTorch Apply
2 Software Engineer, Data Infrastructure
OpenAI
Hybrid (San Francisco, CA) $600k – $1,000,000+ Spark, Iceberg, Flink, Kafka Apply
3 Sr. Staff Engineer, Agentic Systems
Databricks
Hybrid (SF / Mountain View) $450k – $600k+ Delta Lake, Unity Catalog, Mosaic AI, MCP Apply
4 Member of Technical Staff (Inference)
Perplexity AI
Onsite / Hybrid (SF / NYC) $400k – $650k+ vLLM, TensorRT-LLM, Triton, ClickHouse Apply
5 Staff Data Platform Engineer
Netflix
US Remote / Los Gatos, CA $550k – $750k+ (All-Cash) Apache Iceberg, Trino, Flink, Metacat Apply
6 Principal Architect, Cortex AI
Snowflake
US Remote / San Mateo / Bellevue $450k – $650k+ Snowflake, Iceberg, Snowpark, C++ Apply
7 Staff Software Engineer, Streaming & ML
Stripe
US Remote / SF / Seattle $450k – $620k+ Flink, Kafka, RocksDB, Trino, Go/Java Apply
8 Staff Software Engineer, GenAI Platform
Scale AI
Hybrid (San Francisco / NYC) $420k – $580k+ Ray, Spark, ClickHouse, Rust, Kubernetes Apply
9 Staff Software Engineer, Ray Data
Anyscale
Hybrid (San Francisco, CA) $380k – $520k+ Ray, Ray Data, vLLM, C++, KubeRay Apply
10 Member of Technical Staff, Systems
Modal Labs
Onsite / Hybrid (NYC / SF) $350k – $480k+ Rust, Linux Kernel, eBPF, CUDA, gRPC Apply

Detailed Profiles: Top 10 High-Impact US Roles

1. Anthropic — Research Engineer, Pre-training / Data Systems

Team & Mission: Sits within Anthropic’s core Pre-training Data Infrastructure organization, engineering the distributed data pipelines responsible for sourcing, tokenizing, and curating multi-petabyte datasets for next-generation Claude models.

  • Compensation: Base Salary: $350,000 – $500,000 USD | Total Comp: $550,000 – $850,000+ USD (Top-tier equity grants).
  • Tech Stack: Ray, Apache Spark, Python, Rust, PyTorch, Kubernetes, distributed S3/GCS object stores.
  • Strategic Impact: Eliminate web-scale data contamination, toxic content identification bottlenecks, and I/O starvation across tens of thousands of GPU accelerator nodes.

View Requisition & Apply at Anthropic →

2. OpenAI — Software Engineer, Data Infrastructure (Applied AI)

Team & Mission: Part of OpenAI’s Applied AI and Foundations team, scaling the exabyte-scale lakehouse foundation and streaming fabric behind ChatGPT, real-time safety monitoring, and enterprise APIs.

  • Compensation: Base Salary: $210,000 – $405,000 USD | Total Comp: $600,000 – $1,000,000+ USD (Includes Profit Participation Units).
  • Tech Stack: Apache Iceberg, Apache Spark, Apache Flink, Kafka, Python, Go, Rust, Chronon Feature Store.
  • Strategic Impact: Architect point-in-time correct streaming feature stores and petabyte-scale lakehouse clusters with zero downtime under global traffic surges.

View Requisition & Apply at OpenAI →

3. Databricks — Sr. Staff Software Engineer, Agentic Applications & Systems

Team & Mission: Enterprise Agent Systems group at Databricks, architecting mission-critical, human-in-the-loop autonomous agent runtimes on top of Databricks' proprietary Data + AI platform.

  • Compensation: Base Salary: $233,900 – $321,650 USD | Total Comp: $450,000 – $600,000+ USD (Base + Bonus + Equity).
  • Tech Stack: Delta Lake, Unity Catalog, Mosaic AI, MLflow Tracing, LangGraph, Model Context Protocol (MCP).
  • Strategic Impact: Build autonomous agents that execute directly against revenue-critical financial systems of record with deterministic audit logs and policy guardrails.

View Requisition & Apply at Databricks →

4. Perplexity AI — Member of Technical Staff (Inference & Systems)

Team & Mission: Core AI Systems group building the low-latency search, extraction, and generative inference engines servicing millions of conversational search queries daily.

  • Compensation: Base Salary: $220,000 – $485,000 USD | Total Comp: $400,000 – $650,000+ USD (High-velocity equity).
  • Tech Stack: vLLM, TensorRT-LLM, Triton, CUDA, C++, ClickHouse, Kafka, HNSW Vector Indexing.
  • Strategic Impact: Drive sub-100ms multi-index retrieval and dynamic speculative decoding across billions of crawled web pages.

View Requisition & Apply at Perplexity AI →

5. Netflix — Staff Data Platform Engineer (Lakehouse Core)

Team & Mission: Netflix Data Platform Architecture org, stewarding one of the world's largest deployments of Apache Iceberg and Trino to power global streaming personalization.

  • Compensation: All-Cash Total Target Comp: $550,000 – $750,000+ USD (Netflix All-Cash Model).
  • Tech Stack: Apache Iceberg, Trino, Apache Flink, Apache Kafka, Metacat, Java, Scala, AWS S3.
  • Strategic Impact: Drive multi-region Iceberg table compaction, automated storage tiering, and sub-second federated SQL query latency over multi-hundred-petabyte storage.

View Requisition & Apply at Netflix →

6. Snowflake — Principal Data Architect & Systems Engineer (Cortex AI)

Team & Mission: Snowflake Cortex AI & Core Platform, bridging open lakehouse table formats (Iceberg via Polaris Catalog) with serverless LLM and vector execution engines.

  • Compensation: Base Salary: $220,000 – $310,000 USD | Total Comp: $450,000 – $650,000+ USD (Base + Public RSUs + Bonus).
  • Tech Stack: Snowflake Core, Apache Iceberg, Snowpark Container Services, Dynamic Tables, C++, Java.
  • Strategic Impact: Eradicate enterprise data silos by designing universal catalog federation systems and serverless hydration pipelines for Cortex generative AI applications.

View Requisition & Apply at Snowflake →

7. Stripe — Staff Software Engineer, ML Platform & Data Foundations

Team & Mission: Real-time stream processing and decisioning infrastructure powering Stripe Radar across billions of dollars in daily global transactions.

  • Compensation: Base Salary: $210,000 – $285,000 USD | Total Comp: $450,000 – $620,000+ USD (Base + RSUs + Bonus).
  • Tech Stack: Apache Flink, Apache Kafka, RocksDB, Trino, Python, Go, Java, Kubernetes.
  • Strategic Impact: Engineer sub-10ms stateful streaming feature computation with exactly-once semantics and point-in-time correct historical training replay.

View Requisition & Apply at Stripe →

8. Scale AI — Staff Software Engineer, GenAI Platform & RL Environments

Team & Mission: Generative AI Platform and Synthetic Data group, creating the reinforcement learning and evaluation environments relied upon by frontier AI labs.

  • Compensation: Base Salary: $252,000 – $315,000 USD | Total Comp: $420,000 – $580,000+ USD.
  • Tech Stack: Ray, Apache Spark, ClickHouse, PostgreSQL, Python, Rust, Docker, Kubernetes.
  • Strategic Impact: Scale isolated distributed sandboxes capable of generating and validating billions of synthetic code and multi-turn reasoning agent trajectories for RLHF/RLAIF.

View Requisition & Apply at Scale AI →

9. Anyscale — Staff Software Engineer, Ray Data & Platform Core

Team & Mission: Core open-source Ray and commercial Anyscale compute platform engineering team, optimizing distributed data loaders for multi-node GPU clusters.

  • Compensation: Base Salary: $215,000 – $265,000 USD | Total Comp: $380,000 – $520,000+ USD.
  • Tech Stack: Ray, Ray Data, vLLM, C++, Python, gRPC, KubeRay, Linux I/O subsystems.
  • Strategic Impact: Eliminate CPU-to-GPU memory transfer bottlenecks by building streaming data transformation primitives that saturate high-bandwidth interconnects during training and batch inference.

View Requisition & Apply at Anyscale →

10. Modal Labs — Member of Technical Staff (Distributed ML Runtime)

Team & Mission: High-performance serverless cloud runtime engineering group specializing in elastic GPU container scheduling and model serving.

  • Compensation: Base Salary: $180,000 – $320,000 USD | Total Comp: $350,000 – $480,000+ USD.
  • Tech Stack: Rust, Linux Kernel (cgroups, namespaces), eBPF, CUDA, Python, gRPC, NVMe distributed caching.
  • Strategic Impact: Design container runtimes delivering sub-second cold starts on GPU infrastructure with distributed model weight caching across high-speed network fabrics.

View Requisition & Apply at Modal Labs →


Strategic Takeaways for Data & AI Engineers

  1. Master Open Table Formats: Deep proficiency in Apache Iceberg and Delta Lake metadata architectures, compaction algorithms, and catalog federation (Unity Catalog, Polaris) commands top-of-market compensation.
  2. Pivot from Batch to Stateful Streaming: The highest-paying financial and platform roles (Stripe, Netflix, OpenAI) require mastery of Apache Flink, RocksDB state backends, and low-latency feature stores.
  3. Embrace Distributed AI Runtimes: Transitioning data skills into Ray, Ray Data, vLLM, and Rust positions data engineers directly inside high-margin frontier AI infrastructure teams.