Jobs of the Week (US): Top 10 Data & AI Engineering Roles – Week of November 05, 2026
Curated weekly intelligence featuring the top 10 Data Engineering, Lakehouse Architecture, MLOps, and Applied AI roles across the United States with verified compensation ($ USD), core tech stacks, and enterprise use cases.

The landscape of Tier-1 US tech hiring across Silicon Valley, New York City, Seattle, and nationwide remote has reached a definitive inflection point. Modern data engineering is no longer simply building reporting marts or orchestrating batch ETL; it has converged directly with foundation model pre-training pipelines, low-latency agentic execution runtimes, and exabyte-scale open lakehouse storage engines.
Executive Labor Market & Hiring Trends Briefing (United States)
Over the preceding recruiting cycle, data and AI infrastructure hiring has consolidated around three primary architectural vectors:
- Lakehouse Consolidation Around Open Table Formats: Universal adoption of Apache Iceberg and Delta Lake (governed via Unity Catalog and Polaris) has replaced fragmented analytical silos, serving as high-throughput ingestion engines for pre-training data and real-time feature retrieval.
- Real-Time Stream-Table Processing: Batch pipelines are systematically being superseded by sub-second streaming fabrics powered by Apache Flink, Kafka, and RocksDB state backends, especially for mission-critical fraud, risk, and online inference features.
- Agentic Memory & Tool Governance: Frontier engineering teams are architecting transactional governance layers, audit trails, and Model Context Protocol (MCP) integrations for autonomous enterprise agents.
Master Summary: Top 10 US Data & AI Roles of the Week
| Rank | Role & Company | Arrangement | Total Comp (USD $) | Core Tech Stack | Apply |
|---|---|---|---|---|---|
| 1 | Research Engineer, Pre-training Data Anthropic |
Hybrid (SF / Seattle) | $550k – $850k+ | Ray, Spark, Rust, PyTorch | Apply |
| 2 | Software Engineer, Data Infrastructure OpenAI |
Hybrid (San Francisco, CA) | $600k – $1,000,000+ | Spark, Iceberg, Flink, Kafka | Apply |
| 3 | Sr. Staff Engineer, Agentic Systems Databricks |
Hybrid (SF / Mountain View) | $450k – $600k+ | Delta Lake, Unity Catalog, Mosaic AI, MCP | Apply |
| 4 | Member of Technical Staff (Inference) Perplexity AI |
Onsite / Hybrid (SF / NYC) | $400k – $650k+ | vLLM, TensorRT-LLM, Triton, ClickHouse | Apply |
| 5 | Staff Data Platform Engineer Netflix |
US Remote / Los Gatos, CA | $550k – $750k+ (All-Cash) | Apache Iceberg, Trino, Flink, Metacat | Apply |
| 6 | Principal Architect, Cortex AI Snowflake |
US Remote / San Mateo / Bellevue | $450k – $650k+ | Snowflake, Iceberg, Snowpark, C++ | Apply |
| 7 | Staff Software Engineer, Streaming & ML Stripe |
US Remote / SF / Seattle | $450k – $620k+ | Flink, Kafka, RocksDB, Trino, Go/Java | Apply |
| 8 | Staff Software Engineer, GenAI Platform Scale AI |
Hybrid (San Francisco / NYC) | $420k – $580k+ | Ray, Spark, ClickHouse, Rust, Kubernetes | Apply |
| 9 | Staff Software Engineer, Ray Data Anyscale |
Hybrid (San Francisco, CA) | $380k – $520k+ | Ray, Ray Data, vLLM, C++, KubeRay | Apply |
| 10 | Member of Technical Staff, Systems Modal Labs |
Onsite / Hybrid (NYC / SF) | $350k – $480k+ | Rust, Linux Kernel, eBPF, CUDA, gRPC | Apply |
Detailed Profiles: Top 10 High-Impact US Roles
1. Anthropic — Research Engineer, Pre-training / Data Systems
Team & Mission: Sits within Anthropic’s core Pre-training Data Infrastructure organization, engineering the distributed data pipelines responsible for sourcing, tokenizing, and curating multi-petabyte datasets for next-generation Claude models.
- Compensation: Base Salary: $350,000 – $500,000 USD | Total Comp: $550,000 – $850,000+ USD (Top-tier equity grants).
- Tech Stack: Ray, Apache Spark, Python, Rust, PyTorch, Kubernetes, distributed S3/GCS object stores.
- Strategic Impact: Eliminate web-scale data contamination, toxic content identification bottlenecks, and I/O starvation across tens of thousands of GPU accelerator nodes.
View Requisition & Apply at Anthropic →
2. OpenAI — Software Engineer, Data Infrastructure (Applied AI)
Team & Mission: Part of OpenAI’s Applied AI and Foundations team, scaling the exabyte-scale lakehouse foundation and streaming fabric behind ChatGPT, real-time safety monitoring, and enterprise APIs.
- Compensation: Base Salary: $210,000 – $405,000 USD | Total Comp: $600,000 – $1,000,000+ USD (Includes Profit Participation Units).
- Tech Stack: Apache Iceberg, Apache Spark, Apache Flink, Kafka, Python, Go, Rust, Chronon Feature Store.
- Strategic Impact: Architect point-in-time correct streaming feature stores and petabyte-scale lakehouse clusters with zero downtime under global traffic surges.
View Requisition & Apply at OpenAI →
3. Databricks — Sr. Staff Software Engineer, Agentic Applications & Systems
Team & Mission: Enterprise Agent Systems group at Databricks, architecting mission-critical, human-in-the-loop autonomous agent runtimes on top of Databricks' proprietary Data + AI platform.
- Compensation: Base Salary: $233,900 – $321,650 USD | Total Comp: $450,000 – $600,000+ USD (Base + Bonus + Equity).
- Tech Stack: Delta Lake, Unity Catalog, Mosaic AI, MLflow Tracing, LangGraph, Model Context Protocol (MCP).
- Strategic Impact: Build autonomous agents that execute directly against revenue-critical financial systems of record with deterministic audit logs and policy guardrails.
View Requisition & Apply at Databricks →
4. Perplexity AI — Member of Technical Staff (Inference & Systems)
Team & Mission: Core AI Systems group building the low-latency search, extraction, and generative inference engines servicing millions of conversational search queries daily.
- Compensation: Base Salary: $220,000 – $485,000 USD | Total Comp: $400,000 – $650,000+ USD (High-velocity equity).
- Tech Stack: vLLM, TensorRT-LLM, Triton, CUDA, C++, ClickHouse, Kafka, HNSW Vector Indexing.
- Strategic Impact: Drive sub-100ms multi-index retrieval and dynamic speculative decoding across billions of crawled web pages.
View Requisition & Apply at Perplexity AI →
5. Netflix — Staff Data Platform Engineer (Lakehouse Core)
Team & Mission: Netflix Data Platform Architecture org, stewarding one of the world's largest deployments of Apache Iceberg and Trino to power global streaming personalization.
- Compensation: All-Cash Total Target Comp: $550,000 – $750,000+ USD (Netflix All-Cash Model).
- Tech Stack: Apache Iceberg, Trino, Apache Flink, Apache Kafka, Metacat, Java, Scala, AWS S3.
- Strategic Impact: Drive multi-region Iceberg table compaction, automated storage tiering, and sub-second federated SQL query latency over multi-hundred-petabyte storage.
View Requisition & Apply at Netflix →
6. Snowflake — Principal Data Architect & Systems Engineer (Cortex AI)
Team & Mission: Snowflake Cortex AI & Core Platform, bridging open lakehouse table formats (Iceberg via Polaris Catalog) with serverless LLM and vector execution engines.
- Compensation: Base Salary: $220,000 – $310,000 USD | Total Comp: $450,000 – $650,000+ USD (Base + Public RSUs + Bonus).
- Tech Stack: Snowflake Core, Apache Iceberg, Snowpark Container Services, Dynamic Tables, C++, Java.
- Strategic Impact: Eradicate enterprise data silos by designing universal catalog federation systems and serverless hydration pipelines for Cortex generative AI applications.
View Requisition & Apply at Snowflake →
7. Stripe — Staff Software Engineer, ML Platform & Data Foundations
Team & Mission: Real-time stream processing and decisioning infrastructure powering Stripe Radar across billions of dollars in daily global transactions.
- Compensation: Base Salary: $210,000 – $285,000 USD | Total Comp: $450,000 – $620,000+ USD (Base + RSUs + Bonus).
- Tech Stack: Apache Flink, Apache Kafka, RocksDB, Trino, Python, Go, Java, Kubernetes.
- Strategic Impact: Engineer sub-10ms stateful streaming feature computation with exactly-once semantics and point-in-time correct historical training replay.
View Requisition & Apply at Stripe →
8. Scale AI — Staff Software Engineer, GenAI Platform & RL Environments
Team & Mission: Generative AI Platform and Synthetic Data group, creating the reinforcement learning and evaluation environments relied upon by frontier AI labs.
- Compensation: Base Salary: $252,000 – $315,000 USD | Total Comp: $420,000 – $580,000+ USD.
- Tech Stack: Ray, Apache Spark, ClickHouse, PostgreSQL, Python, Rust, Docker, Kubernetes.
- Strategic Impact: Scale isolated distributed sandboxes capable of generating and validating billions of synthetic code and multi-turn reasoning agent trajectories for RLHF/RLAIF.
View Requisition & Apply at Scale AI →
9. Anyscale — Staff Software Engineer, Ray Data & Platform Core
Team & Mission: Core open-source Ray and commercial Anyscale compute platform engineering team, optimizing distributed data loaders for multi-node GPU clusters.
- Compensation: Base Salary: $215,000 – $265,000 USD | Total Comp: $380,000 – $520,000+ USD.
- Tech Stack: Ray, Ray Data, vLLM, C++, Python, gRPC, KubeRay, Linux I/O subsystems.
- Strategic Impact: Eliminate CPU-to-GPU memory transfer bottlenecks by building streaming data transformation primitives that saturate high-bandwidth interconnects during training and batch inference.
View Requisition & Apply at Anyscale →
10. Modal Labs — Member of Technical Staff (Distributed ML Runtime)
Team & Mission: High-performance serverless cloud runtime engineering group specializing in elastic GPU container scheduling and model serving.
- Compensation: Base Salary: $180,000 – $320,000 USD | Total Comp: $350,000 – $480,000+ USD.
- Tech Stack: Rust, Linux Kernel (cgroups, namespaces), eBPF, CUDA, Python, gRPC, NVMe distributed caching.
- Strategic Impact: Design container runtimes delivering sub-second cold starts on GPU infrastructure with distributed model weight caching across high-speed network fabrics.
View Requisition & Apply at Modal Labs →
Strategic Takeaways for Data & AI Engineers
- Master Open Table Formats: Deep proficiency in Apache Iceberg and Delta Lake metadata architectures, compaction algorithms, and catalog federation (Unity Catalog, Polaris) commands top-of-market compensation.
- Pivot from Batch to Stateful Streaming: The highest-paying financial and platform roles (Stripe, Netflix, OpenAI) require mastery of Apache Flink, RocksDB state backends, and low-latency feature stores.
- Embrace Distributed AI Runtimes: Transitioning data skills into Ray, Ray Data, vLLM, and Rust positions data engineers directly inside high-margin frontier AI infrastructure teams.