Jobs of the Week (US): Top 10 Tech, AI & Engineering Roles – Week of November 03, 2026

Curated weekly intelligence featuring the top 10 tech, AI, and engineering roles with verified compensation, required skills, and enterprise use cases.

Share
Jobs of the Week (US): Top 10 Tech, AI & Engineering Roles – Week of November 03, 2026
Photo by Jaime Dantas / Unsplash

Welcome to this week's edition of Jobs of the Week, our definitive intelligence briefing tracking high-impact technical roles across artificial intelligence, distributed systems, platform infrastructure, and modern data architecture. Sourced and verified across native engineering channels, direct ATS pipelines (Ashby, Greenhouse, Lever), and primary tech aggregators, this report unpacks what leading technology organizations are building and what they are willing to pay for top-tier talent.


Over the current hiring cycle, engineering hiring displays a pronounced structural shift toward foundational systems engineering and deployment efficiency:

  • The Shift from Prompt Engineering to Inference Optimization: Generalist LLM fine-tuning roles are normalizing, while demand has surged for low-latency systems engineers skilled in vLLM, TensorRT-LLM, speculative decoding, and custom Triton/CUDA kernel authoring.
  • The Memory & Indexing Wall: With production enterprise RAG and semantic search reaching petabyte scales, high-scale database and systems engineers are commanding substantial premiums to build sub-10ms approximate nearest neighbor (ANN) vector engines and hybrid vector-lexical stores.
  • Compensatory Realities: Compensation transparency filings indicate base salaries between $190,000 and $485,000 USD for Staff and Principal Individual Contributors (ICs), with total compensation packages (inclusive of liquid equity or high-growth pre-IPO option grants) ranging from $450,000 to over $850,000 USD.

Master Summary Comparison Table

Rank Job Title & Company Location & Arrangement Base Salary Range (USD) Core Tech Stack Primary Strategic Use Case Application
1 Staff MTS (Inference Systems)
Anthropic
Hybrid (SF / NYC / Seattle) $320,000 – $485,000 Rust, C++, Python, CUDA, PyTorch, Ray Claude inference serving, KV-cache kernel optimization Apply →
2 Staff Distributed Systems Engineer
Together AI
Remote (US) / SF Hybrid $210,000 – $275,000 Go, C++, CUDA, Triton, Slurm, InfiniBand Multi-cloud bare-metal GPU virtualization & runtimes Apply →
3 Principal Cloud Data Architect
Snowflake
Remote (US / Canada) $264,000 – $380,000 C++, Java, FoundationDB, Iceberg, S3/GCP Sub-second queries over Iceberg open lakehouses Apply →
4 Staff Software Engineer (Vector Retrieval)
Pinecone
Remote (US) / NYC Hybrid $198,000 – $260,000 Rust, Go, C++, SIMD/AVX-512, Raft Billion-scale ANN vector indexing & sub-10ms queries Apply →
5 Staff AI Engineer (RL & Agent Environments)
Scale AI
Hybrid (SF / NYC) $252,000 – $315,000 Python, PyTorch, Ray, Docker, LangChain, vLLM Distributed RLHF/RLAIF agentic simulation environments Apply →
6 Staff Distributed Infrastructure Engineer
Modal
Remote (US) / NYC Hybrid $220,000 – $280,000 Rust, Python, Linux Kernel, eBPF, gVisor Sub-second cold-start serverless container execution Apply →
7 Principal Platform Architect (Lakehouse)
Databricks
Hybrid (SF / Mountain View / Remote) $225,000 – $301,300 Scala, Java, C++, Apache Spark, Delta Lake Petabyte-scale Lakehouse Federation & governance Apply →
8 Senior / Staff AI Infrastructure Engineer
Perplexity AI
Onsite/Hybrid (San Francisco, CA) $200,000 – $280,000 Python, C++, CUDA, vLLM, TensorRT-LLM, Triton Sub-second live web conversational search serving Apply →
9 Staff Infrastructure Engineer (Financial Data)
Stripe
Remote (US / Canada / Dublin) $224,000 – $336,000 Go, Java, Ruby, RocksDB, Kafka, AWS Five-nines distributed ledger for global money movement Apply →
10 Staff MTS (Enterprise RAG & Search)
Cohere
Remote (US / Canada) $200,000 – $265,000 Python, Go, C++, PyTorch, ONNX, Kubernetes Enterprise semantic search & private VPC RAG runtimes Apply →

In-Depth Profiles for Top 10 Jobs of the Week

1. Staff Member of Technical Staff (Inference Systems) — Anthropic

Role Snapshot & Mission: Anthropic develops frontier generative models, including the Claude model family. The Inference Systems team is responsible for scaling real-time serving infrastructure across massive accelerator clusters while minimizing cost-per-token and Time-To-First-Token (TTFT).

Compensation & Benefits: Base salary: $320,000 – $485,000 USD plus significant early-stage equity grants and full tier-1 medical, dental, and health wellness stipends.

Core Technical Stack & Skills: Rust, C++, Python, CUDA, Triton, TensorRT-LLM, Ray, PyTorch runtime internals, RoCE/InfiniBand networking, Linux kernel IPC.

Enterprise Use Cases & Strategic Projects:

  • Architect distributed KV-cache architectures across disaggregated GPU nodes.
  • Implement continuous batching and speculative decoding kernels to accelerate large context-window model generation.
  • Bridge raw hardware compute capabilities with high-availability, public-facing API gateways.

Ideal Candidate Fit: Proven track record in low-level systems programming, deep understanding of GPU memory hierarchies, and experience operating distributed inference runtimes at petabyte scale.

Application: Anthropic Greenhouse Career Portal


2. Staff Distributed Systems Engineer (GPU Platform) — Together AI

Role Snapshot & Mission: Together AI is building the decentralized and centralized compute cloud for frontier AI training and high-throughput inference.

Compensation & Benefits: Base salary: $210,000 – $275,000 USD plus equity options, with typical total compensation reaching $380,000–$450,000 USD.

Core Technical Stack & Skills: Go, C++, CUDA, Triton, Slurm, InfiniBand, RDMA, Kubernetes custom controllers, Linux cgroups, eBPF.

Enterprise Use Cases & Strategic Projects:

  • Design distributed scheduling algorithms across heterogeneous GPU clusters (H100, B200, MI300X).
  • Build fault-tolerant cluster networking and automated failover systems for long-running pre-training checkpoints.
  • Reduce cold-start provisioning latency for dedicated inference endpoints down to under 5 seconds.

Ideal Candidate Fit: Distributed systems engineers with deep experience in high-performance networking (RDMA/InfiniBand), bare-metal orchestration, and container virtualization.

Application: Together AI Careers Portal


3. Principal Cloud Data Architect — Snowflake

Role Snapshot & Mission: Snowflake’s Core Architecture team leads the engineering of Snowflake’s multi-tenant query engine and its open data lakehouse initiatives.

Compensation & Benefits: Base salary: $264,000 – $380,000 USD (up to $402,500 in Tier-1 zones) + 15% cash bonus + generous RSU grants. Typical Total Comp: $650,000–$800,000+ USD.

Core Technical Stack & Skills: C++, Java, FoundationDB, SQL parser/optimizer engines, Apache Iceberg, Parquet, multi-cloud storage APIs (AWS S3, Azure Blob, GCP).

Enterprise Use Cases & Strategic Projects:

  • Architect federated metadata management coordinating billions of files across multi-cloud object storage.
  • Optimize vectorized execution queries directly over Apache Iceberg open table formats without data duplication.
  • Maintain sub-second ACID transactional guarantees on petabyte-scale lakehouse repositories.

Ideal Candidate Fit: Seasoned database architect with extensive expertise in query optimization, storage engines, distributed consensus, and open lakehouse standards.

Application: Snowflake Careers Portal


4. Staff Software Engineer (Vector Retrieval & Storage) — Pinecone

Role Snapshot & Mission: Pinecone is the purpose-built vector database powering generative AI, semantic knowledge retrieval, and enterprise RAG.

Compensation & Benefits: Base salary: $198,000 – $260,000 USD plus competitive equity grants and comprehensive benefits.

Core Technical Stack & Skills: Rust, Go, C++, SIMD (AVX-512, NEON), Raft/Paxos consensus algorithms, AWS S3 / object storage, Kubernetes.

Enterprise Use Cases & Strategic Projects:

  • Build next-generation storage-compute disaggregated engines separating vector indexing from query serving.
  • Implement streaming approximate nearest neighbor (ANN) search algorithms (HNSW, IVF-PQ) capable of continuous real-time updates.
  • Lower memory footprints by caching graph indices directly on local NVMe SSDs with sub-10ms retrieval latencies.

Ideal Candidate Fit: High-performance systems coder with deep knowledge of SIMD vector instructions, distributed indexing, and disk-backed graph algorithms.

Application: Pinecone Ashby Portal


5. Staff AI Engineer (RL & Agent Environments) — Scale AI

Role Snapshot & Mission: Scale AI provides the foundational data engine, evaluation environments, and reinforcement learning infrastructure for leading AI labs.

Compensation & Benefits: Base salary: $252,000 – $315,000 USD plus equity options/RSUs.

Core Technical Stack & Skills: Python, PyTorch, Ray, Docker sandboxing, LangChain, vLLM, Redis, PostgreSQL, async Python.

Enterprise Use Cases & Strategic Projects:

  • Architect distributed agentic simulation sandboxes where LLMs interact with real coding environments, shell consoles, and web browsers.
  • Construct automated reward modeling and rejection sampling pipelines for synthetic data generation.
  • Scale multi-turn evaluation frameworks that measure latency, security guardrails, and deterministic tool usage.

Ideal Candidate Fit: ML practitioner with real-world experience building reinforcement learning pipelines, agent orchestration, and isolated sandboxed execution systems.

Application: Scale AI Greenhouse Portal


6. Staff Systems & Distributed Infrastructure Engineer — Modal

Role Snapshot & Mission: Modal is an ultra-fast serverless cloud platform built for AI/ML workloads, enabling data scientists and ML engineers to run distributed jobs with sub-second spin-up.

Compensation & Benefits: Base salary: $220,000 – $280,000 USD plus a top-tier early equity stake.

Core Technical Stack & Skills: Rust, Python, Linux Kernel, eBPF, gVisor, WireGuard, custom virtualization, distributed consensus.

Enterprise Use Cases & Strategic Projects:

  • Redesign container virtualization internals to achieve sub-second cold starts for multi-gigabyte container images.
  • Build high-performance P2P container image distribution layers over high-speed intra-datacenter networks.
  • Optimize multi-tenant GPU memory sharing and zero-copy data streaming from cloud storage into GPU VRAM.

Ideal Candidate Fit: Deep systems hacker comfortable modifying container runtimes, diving into the Linux kernel, and optimizing low-level network and hypervisor stacks.

Application: Modal Ashby Portal


7. Principal Platform Architect (Core Data Lakehouse) — Databricks

Role Snapshot & Mission: Databricks drives the Apache Spark, Delta Lake, and Unity Catalog ecosystems, defining how Fortune 500 enterprises unify analytics, governance, and AI.

Compensation & Benefits: Base salary: $225,000 – $301,300 USD (Zone 1) + annual performance bonus + substantial RSU package (Total Comp: $500,000–$650,000+ USD).

Core Technical Stack & Skills: Scala, Java, C++, Apache Spark, Delta Lake, Presto/Trino, Kubernetes, distributed consensus.

Enterprise Use Cases & Strategic Projects:

  • Architect Lakehouse Federation protocols that unify data access, lineage, and access-control policies across diverse clouds and warehouses.
  • Engineer streaming architectures capable of sustained ingestion of 50M+ events/second with exactly-once processing guarantees.
  • Unify structured tabular data with unstructured vector embeddings under a centralized enterprise governance layer (Unity Catalog).

Ideal Candidate Fit: Veteran distributed systems architect who has contributed to or architected core engines within Apache Spark, Trino, or Delta Lake at massive scale.

Application: Databricks Careers Board


8. Senior / Staff AI Infrastructure Engineer — Perplexity AI

Role Snapshot & Mission: Perplexity is revolutionizing conversational search by combining LLM synthesis with real-time web search and index grounding.

Compensation & Benefits: Base salary: $200,000 – $280,000 USD + high-upside pre-IPO equity.

Core Technical Stack & Skills: Python, C++, CUDA, vLLM, TensorRT-LLM, Triton Server, Redis, async networking, distributed cache architectures.

Enterprise Use Cases & Strategic Projects:

  • Build high-throughput LLM routing systems that triage incoming user questions across small, fast routing models and larger reasoning models.
  • Optimize live search retrieval pipelines to synthesize multiple search engine result pages (SERPs) and generate citations in under 800 milliseconds.
  • Develop custom continuous-batching serving clusters running across bare-metal GPU clusters.

Ideal Candidate Fit: Infrastructure engineer passionate about real-time latency optimization, asynchronous networking, and serving production LLMs to hundreds of millions of daily queries.

Application: Perplexity Ashby Portal


9. Staff Infrastructure Engineer (Financial Data Path) — Stripe

Role Snapshot & Mission: Stripe’s Data Infrastructure and Ledger teams build the distributed databases and state engines that guarantee money movement across global rails without losing a single cent.

Compensation & Benefits: Base salary: $224,000 – $336,000 USD + competitive annual RSU grant (Total Comp: $450,000–$600,000+ USD).

Core Technical Stack & Skills: Go, Java, Ruby, RocksDB, Apache Kafka, Distributed Relational Engines (Spanner/Vitess), AWS.

Enterprise Use Cases & Strategic Projects:

  • Design distributed ledger architectures that achieve 99.9999% uptime with idempotent event sourcing.
  • Migrate petabyte-scale transactional databases across multi-region active-active cloud clusters with zero downtime.
  • Build high-volume streaming reconciliation systems processing over $1 trillion in annualized transaction volume.

Ideal Candidate Fit: Distributed database engineer who treats zero data loss and strict consistency as non-negotiable requirements under extreme transaction concurrency.

Application: Stripe Careers Portal


10. Staff Member of Technical Staff (Enterprise RAG & Search) — Cohere

Role Snapshot & Mission: Cohere builds privacy-first foundation models, high-performance multilingual text embeddings, and reranking models specifically tailored for enterprise customer deployments.

Compensation & Benefits: Base salary: $200,000 – $265,000 USD + equity.

Core Technical Stack & Skills: Python, Go, C++, PyTorch, ONNX Runtime, Hugging Face, Kubernetes, Terraform, AWS/GCP/OCI.

Enterprise Use Cases & Strategic Projects:

  • Architect enterprise retrieval-augmented generation (RAG) connectors that interface natively with private customer data stores (SharePoint, Salesforce, Confluence).
  • Optimize quantized embedding and reranker models for low-latency inference on CPU and single-GPU instances.
  • Implement isolated, air-gapped on-premises / private VPC deployment automations for financial services and healthcare clients.

Ideal Candidate Fit: Applied AI/ML engineer with expertise in semantic search, embedding quantization, model serving on constrained hardware, and enterprise VPC compliance.

Application: Cohere Ashby Board


Strategic Takeaways & Upskilling Recommendations

  1. Master Inference Kernels & Runtime Engines: The highest-leverage engineering skill today is understanding how to squeeze maximum utilization out of GPUs. Familiarize yourself with vLLM, TensorRT-LLM, and writing custom Triton kernels.
  2. Bridge Storage and Compute in Modern Data Lakes: Organizations are breaking out of proprietary data warehouses. Hands-on experience with Apache Iceberg, Delta Lake 3.0, and Lakehouse Federation protocols will position you for senior platform roles.
  3. Quantify Real-World Production Latency & Fault Tolerance: When tailoring resumes or interviewing, emphasize concrete numbers: P99 latency reductions, throughput improvements (tokens/sec/dollar), cluster failover recovery times, and data integrity guarantees.