Jobs of the Week (US): Top 10 Applied AI & Agentic Systems Engineering Roles – Week of November 05, 2026

Curated weekly intelligence featuring the top 10 Applied AI, Agentic Systems, Enterprise RAG, and LLM Application Engineering roles across the US with verified compensation ($180k–$360k+ USD), core AI stacks, and production use cases.

Share
Conceptual visualization of an artificial neural network superimposed on an advanced silicon microchip processor
Photo by mikemacmarketing via Wikimedia Commons (CC BY 2.0)

Over the past hiring cycle, the United States enterprise artificial intelligence labor market crossed an unmistakable architectural inflection point. The early era of generative AI experimentation—characterized by naive retrieval-augmented generation (RAG) and fragile, single-turn prompt chains—has given way to the engineering discipline of deterministic agentic state machines, continuous evaluation harnesses, and sub-second inference pipelines. For senior engineers, engineering leads, and technology strategists navigating the market, the signal is clear: foundational labs, frontier unicorns, and enterprise Centers of Excellence (CoEs) are actively competing for practitioners who can enforce determinism over probabilistic model behavior.


The transition from prototype to production has fundamentally altered what enterprise engineering leaders screen for when hiring Applied AI talent across top technology corridors—including the San Francisco Bay Area, Seattle, New York City, Austin, and US Nationwide Remote hubs.

1. From Unconstrained ReAct Loops to Stateful Directed Acyclic Graphs (DAGs)

In 2023 and early 2024, early autonomous agents relied heavily on open-ended ReAct (Reason + Act) prompting loops. In enterprise production, however, unconstrained agent loops led to runaway token costs, infinite execution cycles, and unpredictable tool calling. Current enterprise architectures have largely pivoted to deterministic finite-state automata and stateful graph orchestrators (such as LangGraph, CrewAI, and proprietary state engines). Production systems require checkpointing, state serialization, deterministic transactional fallbacks, and rigorous Human-in-the-Loop (HITL) intervention protocols before mutating backend databases or customer-facing accounts.

2. The Evolution of Enterprise RAG 2.0

Naive vector similarity search using out-of-the-box embeddings is no longer considered production-ready for mission-critical enterprise workloads. Production-grade retrieval now standardizes on hybrid retrieval architectures that marry sparse lexical indexing (BM25 / Splade) with dense vector representations (Qdrant, pgvector, Milvus). Furthermore, top teams enforce cross-encoder reranking (Cohere Rerank, BGE), dynamic query decomposition, contextual document chunking, and fine-grained Role-Based Access Control (RBAC) filtering enforced at the vector query boundary.

3. Evaluation as the Core CI/CD Primitive

Hiring managers at organizations like Anthropic, OpenAI, Databricks, and Scale AI emphasize programmatic evaluation over heuristic manual testing. Modern Applied AI engineering mandates automated evaluation suites—leveraging frameworks such as Ragas, TruLens, Arize Phoenix, and MLflow LLM-as-a-Judge. Teams benchmark synthetic datasets against production telemetry, track semantic drift across model updates, and implement programmatic optimization frameworks like DSPy to systematically discover high-performing prompt signatures and few-shot exemplars.

Statutory pay transparency regulations across California, Washington, and New York provide clear visibility into Applied AI compensation bands. For senior and staff-level Applied AI and agentic systems engineers, base salary corridors have coalesced between $180,000 and $385,000 USD. Total annual compensation—when factoring in liquid restricted stock units (RSUs) at publicly traded firms or high-leverage equity options at venture-backed unicorns—frequently scales from $320,000 to over $750,000+ USD.


Master Summary Comparison Table: Top 10 Curated US Roles

Rank Role Title & Company Hub Location & Arrangement Calibrated Compensation ($ USD) Core Applied AI & Agentic Stack Enterprise AI Mandate Apply Reference
1 Applied AI Engineer (Enterprise & Startups)
Anthropic
San Francisco, CA (Hybrid, 25% Onsite) $280,000 – $320,000 Base + Top-Tier Equity Python, TypeScript, Claude SDK, Tool-Use APIs, Prompt Evaluations, PyTorch Production reference agent architectures, enterprise evals, and multi-turn workflows for Claude 3.5. Anthropic Careers
2 Forward Deployed Engineer (Applied AI)
OpenAI
San Francisco, CA / New York, NY (Hybrid) $211,000 – $385,000 Base (+ PPUs / Equity; TC ~$450k–$750k+) Python, TypeScript, Assistants API, vLLM, Vector Retrieval, Kubernetes Production embedding of bespoke enterprise agents and retrieval systems with Fortune 500 partners. OpenAI Careers
3 Member of Technical Staff (Applied AI & Agents)
Perplexity AI
San Francisco, CA (Onsite) $220,000 – $405,000 Base + Meaningful Equity Python, C++, CUDA/TensorRT-LLM, Hybrid RAG, Vector Search, FastAPI Sub-second multi-source real-time RAG, agentic research engines, and citation hallucination guards. Perplexity Careers
4 Software Engineer, Agent Systems
Sierra
San Francisco, CA / US Remote (Flexible) $180,000 – $390,000 Base + High-Growth Equity Python, LangGraph / State Machines, TypeScript, Redis, Postgres, Tracing Mission-critical autonomous customer-facing enterprise agents with transactional guarantees. Sierra Careers
5 Staff Software Engineer (AI Platform & Agents)
Harvey AI
San Francisco, CA / New York, NY (Hybrid) $231,000 – $340,000 Base + Equity & Bonus Python, LangChain, LlamaIndex, pgvector, Azure OpenAI, FastAPI, Next.js Multi-step legal contract analysis agents, deterministic multi-document RAG, and audit trails. Harvey Careers
6 Member of Technical Staff (AI Systems & Infra)
Cursor (Anysphere)
San Francisco, CA (In-Person) $220,000 – $440,000 Base + High-Leverage Equity Rust, TypeScript, Python, Custom Caching, Triton, vLLM, LSP Speculative code generation, whole-codebase context indexing, and sub-100ms multi-model inference. Cursor Careers
7 Applied AI Engineer (Enterprise Deployment)
Cognition AI
San Francisco, CA / US Remote $180,000 – $225,000 Base (+ Tier-1 Options; TC ~$320k–$500k) Python, TypeScript, Docker Sandboxes, Headless Browsers, AST Parsing, Evals Real-world autonomous software development agent sandboxing, tool-execution loops, and CLI autonomy. Cognition Careers
8 Staff Applied ML Engineer (Enterprise Search & RAG)
Glean
Palo Alto, CA / US Remote $210,000 – $300,000 Base + Pre-IPO Equity Python, Java/Go, Hybrid Search (Dense+BM25), Cross-Encoders, Qdrant, GCP Enterprise semantic knowledge graphs across 100+ connectors, zero-trust RBAC ACL enforcement at retrieval. Glean Careers
9 Staff Solutions Architect (GenAI & Mosaic AI)
Databricks
San Francisco, CA / Seattle, WA / Remote $219,100 – $301,300 Base (+ 20% Variable + Pre-IPO RSUs) Python, MLflow, Mosaic AI Gateway, LangChain, LlamaIndex, Spark, Unity Catalog Enterprise LLM evaluation (LLM-as-a-Judge), guardrails, fine-tuning, and compound AI governance. Databricks Careers
10 Staff Forward Deployed AI Engineer
Scale AI
San Francisco, CA / New York, NY (Hybrid) $205,600 – $300,000 Base + Equity Grants Python, LangGraph, vLLM, Bedrock/Azure, Weaviate/Pinecone, Docker, Tracing Custom enterprise Copilots, model evaluation harnesses (RLHF/DPO pipelines), and national security AI systems. Scale AI Careers

In-Depth Profiles: Top 10 US Applied AI Jobs of the Week

1. Anthropic — Applied AI Engineer (Enterprise & Startups)

Company & AI Initiative Snapshot: Anthropic stands at the frontier of safety-oriented foundation model research, authoring the industry-defining Claude model family. The Enterprise Applied AI team bridges cutting-edge research and mission-critical production environments, working directly with strategic enterprise partners to design high-reliability architectures for Claude 3.5 Sonnet, Claude 3.5 Haiku, and emerging computer-use agent frameworks.

Compensation & Equity: Base salary is established between $280,000 and $320,000 USD annually, complemented by top-tier private equity grants, comprehensive medical/dental/vision coverage, and 401(k) matching.

Core Technical Stack & Frameworks: Python, TypeScript, Claude SDK, Model Context Protocol (MCP), Anthropic Prompt Evaluation tools, PyTorch, FastAPI, AWS Bedrock, and GCP Vertex AI.

Real-World Production Challenges & Agentic Impact: Designing deterministic tool-calling workflows across multi-turn enterprise conversations. Engineers tackle complex multi-step reasoning bottlenecks, construct robust latency mitigation strategies across high-concurrency API environments, and build standardized client-facing evaluation harnesses that verify safety and policy adherence under heavy enterprise throughput.

Ideal Candidate Profile: 5+ years of software engineering experience with deep specialization in production LLM application design, robust full-stack systems engineering skills, and a demonstrated portfolio of building deterministic agentic tool integrations.

Application Link: Apply at Anthropic Career Portal


2. OpenAI — Forward Deployed Engineer (Applied AI)

Company & AI Initiative Snapshot: OpenAI is the pioneer behind GPT-4o, OpenAI o1, and ChatGPT. The Forward Deployed Engineering (FDE) organization embeds directly within tier-1 enterprise organizations across financial services, healthcare, and global SaaS to build bespoke generative AI solutions directly upon frontier infrastructure.

Compensation & Equity: Base salary ranges from $211,000 to $385,000 USD (calibrated across levels), coupled with OpenAI Profit Participation Units (PPUs) that historically place total compensation between $450,000 and $750,000+ USD.

Core Technical Stack & Frameworks: Python, Go, TypeScript, OpenAI Assistants API, Function Calling & Structured Outputs, vLLM, pgvector, Kubernetes, and distributed inference proxies.

Real-World Production Challenges & Agentic Impact: Deploying compound AI systems within strictly regulated enterprise boundaries. Engineers resolve strict zero-data-retention compliance requirements, design stateful multi-agent workflows that interface with legacy enterprise databases, and tune custom models to eliminate hallucination in mission-critical customer operations.

Ideal Candidate Profile: Exceptional full-stack systems builder with significant enterprise customer-facing acumen, strong systems architecture intuition, and proven experience operating production AI systems at scale.

Application Link: Apply at OpenAI Careers


3. Perplexity AI — Member of Technical Staff (Applied AI & Agents)

Company & AI Initiative Snapshot: Perplexity is revolutionizing digital discovery by delivering verified, real-time conversational search engines that directly replace traditional link-based search indexing.

Compensation & Equity: Base salary spans $220,000 to $405,000 USD, backed by an equity grant in one of the fastest-growing AI unicorns in the technology ecosystem.

Core Technical Stack & Frameworks: Python, C++, CUDA, TensorRT-LLM, Hybrid Retrieval (BM25 + Dense Vectors), Redis Cache, FastAPI, Asyncio, and PyTorch.

Real-World Production Challenges & Agentic Impact: Delivering sub-second end-to-end latency across dynamic web indexing and real-time LLM synthesis. Engineers architect autonomous search routing agents that decompose ambiguous user queries, retrieve and rank disparate web nodes in parallel, extract structured DOM elements, and ensure rigorous citation accuracy without synthetic hallucination.

Ideal Candidate Profile: High-velocity systems engineer with a background in low-latency backend systems, distributed vector indexing, and production inference optimization.

Application Link: Apply at Perplexity Ashby Portal


4. Sierra — Software Engineer, Agent Systems

Company & AI Initiative Snapshot: Founded by Bret Taylor (former co-CEO of Salesforce and OpenAI Board Chair) and Clay Bavor (former VP of Google Labs), Sierra is building enterprise conversational agent systems for global brands such as Sonos, SiriusXM, and WeightWatchers.

Compensation & Equity: Base compensation ranges from $180,000 to $390,000 USD, supported by top-tier venture equity packages.

Core Technical Stack & Frameworks: Python, LangGraph / StateDAG Orchestrators, TypeScript, React, PostgreSQL, Redis, and OpenTelemetry-based LLM observability.

Real-World Production Challenges & Agentic Impact: Solving the fundamental enterprise challenge of non-determinism. The team builds deterministic agent supervisory architectures where autonomous sub-agents handle inventory lookups, payment processing, and policy enforcement while providing ironclad transactional rollback guarantees and prompt injection immunity.

Ideal Candidate Profile: Distributed systems engineer with production experience in state machines, workflow engines, and LLM orchestration frameworks.

Application Link: Apply at Sierra Ashby Portal


5. Harvey AI — Staff Software Engineer (AI Platform & Agents)

Company & AI Initiative Snapshot: Backed by the OpenAI Startup Fund and Kleiner Perkins, Harvey is the market-leading enterprise legal AI platform deployed across elite global law firms, accounting networks, and Fortune 500 corporate legal departments.

Compensation & Equity: Base salary is calibrated between $231,000 and $340,000 USD, accompanied by an attractive equity grant and annual bonus structure.

Core Technical Stack & Frameworks: Python, LangChain, LlamaIndex, pgvector, Azure OpenAI Service, FastAPI, Next.js, Redis, Docker, and Pydantic.

Real-World Production Challenges & Agentic Impact: Implementing deterministic document reasoning over massive, unstructured corporate repositories (such as 1,000-page complex merger agreements and litigation transcripts). Engineers build multi-agent contract review workflows, cross-referencing agents, and strict citation-grounded RAG pipelines evaluated with domain-specific LLM-as-a-Judge harnesses.

Ideal Candidate Profile: Staff-level engineer with a deep background in distributed database architecture, vector search, and complex multi-document text processing pipelines.

Application Link: Apply at Harvey Ashby Portal


6. Cursor (Anysphere) — Member of Technical Staff (AI Systems & Infra)

Company & AI Initiative Snapshot: Anysphere's flagship product, Cursor, is the AI-first code editor fork of VS Code that has rapidly captured widespread adoption among senior software engineers worldwide.

Compensation & Equity: Base salary is positioned between $220,000 and $440,000 USD, with significant venture equity options.

Core Technical Stack & Frameworks: Rust, TypeScript, Python, Language Server Protocol (LSP), Tree-sitter AST, Custom Context Caching, Triton, and vLLM.

Real-World Production Challenges & Agentic Impact: Engineering speculative code generation and whole-codebase context indexing at sub-100ms response times. The team develops background autonomous agent loops that parse terminal outputs, detect compiler errors, manipulate multi-file AST trees, and autonomously apply edits with high syntactical fidelity.

Ideal Candidate Profile: Systems-level polyglot engineer proficient in Rust and TypeScript, with intimate knowledge of compiler internals, editor architectures, and high-performance inference serving.

Application Link: Apply at Cursor Careers


7. Cognition AI — Applied AI Engineer (Enterprise Deployment)

Company & AI Initiative Snapshot: Cognition AI is the creator of Devin, the autonomous AI software engineer. Valued at $2B and backed by Founders Fund, the team builds autonomous agents capable of end-to-end software development execution.

Compensation & Equity: Base salary spans $180,000 to $225,000 USD, with high-upside equity pushing total compensation into the $320,000–$500,000+ USD corridor.

Core Technical Stack & Frameworks: Python, TypeScript, Docker Sandboxing, Headless Playwright/Puppeteer, Tree-sitter AST, and Custom Reinforcement Learning evaluation harnesses.

Real-World Production Challenges & Agentic Impact: Safely embedding autonomous agents within enterprise production environments. Engineers design isolated microVM sandboxes, manage multi-hour autonomous execution loops, parse complex terminal outputs, and build self-correcting mechanisms allowing Devin to clone, build, test, and submit PRs across enterprise codebases without human intervention.

Ideal Candidate Profile: Software engineer with extensive experience in developer environments, containerized virtualization, browser automation, and stateful agent architectures.

Application Link: Apply at Cognition Ashby Portal


8. Glean — Staff Applied ML Engineer (Enterprise Search & RAG)

Company & AI Initiative Snapshot: Founded by former Google search leadership, Glean is the premier workplace AI search and knowledge discovery platform, integrating across 100+ enterprise SaaS platforms including Slack, Google Drive, Jira, and GitHub.

Compensation & Equity: Base salary ranges from $210,000 to $300,000 USD, accompanied by substantial pre-IPO equity grants.

Core Technical Stack & Frameworks: Python, Java, Go, Milvus, Qdrant, BM25 + Dense Hybrid Retrieval, Cross-Encoder Rerankers, GCP, and Kubeflow.

Real-World Production Challenges & Agentic Impact: Solving dynamic, real-time access-control filtering across hundreds of millions of enterprise documents. Glean's Applied AI team builds contextual semantic search architectures that enforce strict zero-trust permission models on every query without sacrificing sub-second retrieval SLAs.

Ideal Candidate Profile: Senior or staff search/information retrieval engineer with proven track records building enterprise search systems, distributed vector storage, and production reranking pipelines.

Application Link: Apply at Glean Greenhouse Portal


9. Databricks — Staff Solutions Architect (GenAI & Mosaic AI)

Company & AI Initiative Snapshot: Databricks is the global data, analytics, and AI powerhouse behind the Lakehouse architecture, Apache Spark, MLflow, and Mosaic AI.

Compensation & Equity: Base salary is calibrated between $219,100 and $301,300 USD, complemented by a 20% variable incentive plan and pre-IPO Databricks equity.

Core Technical Stack & Frameworks: Python, Apache Spark, MLflow, Mosaic AI Gateway, LangChain, LlamaIndex, Unity Catalog, and PyTorch.

Real-World Production Challenges & Agentic Impact: Acting as the senior technical architect guiding Fortune 100 enterprise customers deploying Compound AI Systems. Mandates include architecting end-to-end evaluation pipelines using MLflow LLM-as-a-Judge, orchestrating secure fine-tuning on proprietary data lakes, and configuring low-latency Mosaic AI Gateway proxies with automated guardrails.

Ideal Candidate Profile: Customer-facing enterprise systems architect with demonstrated expertise in enterprise data infrastructure, LLM lifecycle management, and scalable model governance.

Application Link: Apply at Databricks Careers


10. Scale AI — Staff Forward Deployed AI Engineer (Enterprise GenAI)

Company & AI Initiative Snapshot: Valued at $14B, Scale AI provides foundational data and application infrastructure for OpenAI, Meta, the US Department of Defense, and Fortune 500 enterprises.

Compensation & Equity: Base salary spans $205,600 to $300,000 USD, accompanied by an extensive equity package and full benefits.

Core Technical Stack & Frameworks: Python, FastAPI, Docker, Kubernetes, LangGraph, vLLM, Triton, Pinecone, Azure OpenAI, and Arize Phoenix.

Real-World Production Challenges & Agentic Impact: Engineering and operationalizing enterprise-grade GenAI Copilots and agentic decision workflows. Engineers construct specialized RLHF and DPO evaluation pipelines, implement rigorous guardrails (Llama Guard, NeMo), and orchestrate real-time multi-agent systems for critical industrial and public sector clients.

Ideal Candidate Profile: Full-stack engineer experienced in forward-deployed architectures, rapid client-facing prototyping, and productionizing distributed machine learning pipelines.

Application Link: Apply at Scale AI Careers


Strategic Takeaways & Applied AI Upskilling Roadmap

For engineers seeking to maximize career leverage in the Applied AI domain, the technical qualifications have shifted dramatically away from basic model calling toward systems engineering rigor:

  1. Master Deterministic State Machines: Move beyond basic chain abstractions. Gain practical experience with LangGraph, custom directed graphs, state persistence with Redis/PostgreSQL, and human-in-the-loop transactional checkpoints.
  2. Standardize on Programmatic Optimization: Familiarize yourself with DSPy (Declarative Self-improving Language Programs). Replacing hand-crafted prompt tinkering with programmatic compilation and automated evaluation is rapidly becoming standard practice across leading AI teams.
  3. Build Production Evaluation Harnesses: Develop proficiency in Ragas, TruLens, and MLflow LLM-as-a-Judge. Enterprise hiring teams consistently prioritize engineers who can mathematically quantify model accuracy, drift, and hallucination reduction over those who simply integrate API endpoints.
  4. Specialize in Low-Latency Hybrid Retrieval: Build practical systems incorporating sparse-dense hybrid search, cross-encoder rerankers, and dynamic permission filtering. Production RAG is fundamentally a distributed data systems challenge.