475 matching jobs for “Senior Principal AI Engineer”

How results work

Exact titles rank first, then title variations and keywords in descriptions. These labels aren't qualification scores. Without keywords, recently added jobs appear first.

Northern Trust

Principal - IAM Platform Operations

Tempe, Arizona, United States

Full time
Regular

The Principal, IAM Platform Operations serves as the senior technical and operational authority for Northern Trust's …

Added Oct 16, 2026

Save job

Vertex Pharmaceuticals

Senior Principal Scientist, Agentic Systems Development for Drug Discovery

Boston, Massachusetts, United States

Full time
Regular

Pay posted by employer$168,000–$252,000

Vertex is seeking an accomplished Senior Principal Scientist with proven record of developing, testing and deploying scientific computational …

Added Oct 18, 2026

Save job

Abbott Laboratories

IT Director, Data & AI Architecture

Waukegan, Illinois, United States +1 location

Pay posted by employer$149,300–$298,700

… & Analytics, this person will play a critical role in defining and delivering Abbott's enterprise data and AI architecture vision. This leader will architect scalable, secure, and AI-ready data platforms, enable …

Added Oct 20, 2026

Save job

Visa

Principal ML Scientist

Austin, Texas, United States

Pay posted by employer$217,900–$349,000 USD per year

… across other networks. The Visa Engage, Resolve, & Assist (VERA) team in VAS focuses on innovative, AI-driven solutions for issuers, merchants and fintechs. The Chief Software Engineer – GenAI Platform in the …

Added Oct 27, 2026

Save job

Booz Allen Hamilton

System Safety Engineer, Senior

Arlington, Virginia, United States +2 locations

Pay posted by employer$62,000–$141,000

System Safety Engineer, Senior The Opportunity: Are you looking for an opportunity to combine your technical skills with big …

Added Oct 27, 2026

Save job

Nvidia

Senior Research Engineer, Simulation

Santa Clara, California, United States

NVIDIA is searching for a senior or principal engineer who specializes in physics simulation in the Generalist Embodied Agent Research …

Added Oct 31, 2026

Save job

Booz Allen Hamilton

DevOps Platform Engineer, Senior

San Diego, California, United States

Pay posted by employer$77,600–$176,000

DevOps Platform Engineer, Senior The Opportunity: Everyone is trying to “harness the cloud,” but not everyone knows how. As a DevOps …

Added Oct 30, 2026

Save job

Caterpillar

Principal Agentic Robotics Architect

Irving, Texas, United States

Pay posted by employer$147,760–$240,110

… By combining deep domain expertise in physical systems with software, connectivity, autonomy, and AI, we deliver solutions that work in the real world–on real jobsites, at global scale. You’ll build and …

Added Oct 27, 2026

Save job

Caterpillar

Principal Robotics Validation Architect

Irving, Texas, United States

Pay posted by employer$147,760–$240,110

Added Oct 27, 2026

Save job

Vertex Pharmaceuticals

Optics / Microscopy Principal Scientist

San Diego, California, United States

Full time
Regular

Pay posted by employer$144,400–$216,600

… enabling capabilities that are not commercially available. We are seeking an experienced and innovative Principal Scientist with expertise in optical design, microscopy, and functional imaging to join our team. This role …

Added Oct 18, 2026

Save job

Caterpillar

Principal Spatial Intelligence Architect

Irving, Texas, United States +1 location

Pay posted by employer$175,030–$284,430

… By combining deep domain expertise in physical systems with software, connectivity, autonomy, and AI, we deliver solutions that work in the real world—on real jobsites, at global scale. You’ll build and …

Added Oct 27, 2026

Save job

Caterpillar

Principal Robotics Platform Architect

Irving, Texas, United States +1 location

Pay posted by employer$175,030–$284,430

Added Oct 27, 2026

Save job

Applied Materials

Director, Product AI Platform Architect

Santa Clara, California, United States

Pay posted by employer$218,500–$300,500

We are developing a single AI platform that serves multiple business units, running inside an air-gapped environment. This role owns the …

Added Oct 27, 2026

Save job

Cencora

Principal Administrator, Systems Management

Vilnius, Vilnius, Lithuania

Full time

… and maintain runbooks, playbooks, and disaster recovery procedures that are clear, tested, and actionable. AI Tooling & Innovation Lead the evaluation, integration, and operationalization of AI-powered tooling, with a …

Added Oct 27, 2026

Save job

Elevance Health

Principal Cloud Security Architect

Grand Prairie, Texas, United States +6 locations

Full time
Regular

Principal Cloud Security Architect Location: This role requires associates to be in-office 1 - 2 days per week, …

Added Oct 28, 2026

Save job

Nvidia

Principal Solutions Architect – Semiconductor Test

Santa Clara, California, United States

We are seeking a Staff/Principal Solutions Architect to define and lead the technical strategy for semiconductor test. This covers wafer and …

Added Oct 31, 2026

Save job

Amgen

Principal IS Unix Architect

United States - Remote

Full time
Regular

… as part of the Amgen team. Join us and transform the lives of patients while transforming your career. Principal IS Unix Architect What you will do Let’s do this. Let’s change the world. In this vital role, you will …

Added Oct 15, 2026

Save job

Cisco Systems

Senior Software Engineer - Webex

Galway, Connacht, Ireland

… regardless of device or location, empowering the hybrid working patterns of the future. Focusing on AI features for the Webex Calling solution, our team works to integrate the latest artificial intelligence …

Added Oct 27, 2026

Save job

Nvidia

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

Santa Clara, California, United States +2 locations

Added Oct 31, 2026

Save job

Cisco Systems

Principal Software Engineer | Optical Solutions LeadOptical Solutions Lead (DWDM/ROADM)

Bengaluru, Karnataka, India

… a diverse and collaborative team of innovators dedicated to crafting the future of optical technology. As a Principal engineer here, you'll have the opportunity to solve complex challenges in high-capacity optical …

Added Oct 30, 2026

Save job

Nvidia

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems

Santa Clara, California, United States +2 more

View job

Save job

About this opportunity

Original employer description

NVIDIA Dynamo is a high-throughput, low-latency inference framework for serving generative AI and reasoning models across multi-node distributed environments. Built in Rust for performance and Python for extensibility, Dynamo orchestrates GPU shards, routes requests, and manages shared KV cache across heterogeneous clusters so that many accelerators feel like a single system at datacenter scale. As large language models rapidly outgrow the memory and compute budget of any single GPU, this platform enables efficient, resilient deployment of cutting-edge LLM workloads.

We are seeking a Principal Systems Engineer to define the vision and roadmap for memory management of large-scale LLM and storage systems.

What you'll be doing:

Design and evolve a unified memory layer that spans GPU memory, pinned host memory, RDMA-accessible memory, SSD tiers, and remote file/object/cloud storage to support large-scale LLM inference.
Architect and implement deep integrations with leading LLM serving engines (such as vLLM, SGLang, TensorRT-LLM), with a focus on KV-cache offload, reuse, and remote sharing across heterogeneous and disaggregated clusters.
Co-design interfaces and protocols that enable disaggregated prefill, peer-to-peer KV-cache sharing, and multi-tier KV-cache storage (GPU, CPU, local disk, and remote memory) for high-throughput, low-latency inference.
Partner closely with GPU architecture, networking, and platform teams to exploit GPUDirect, RDMA, NVLink, and similar technologies for low-latency KV-cache access and sharing across heterogeneous accelerators and memory pools.
Mentor senior and junior engineers, set technical direction for memory and storage subsystems, and represent the team in internal reviews and external forums (open source, conferences, and customer-facing technical deep dives).

What we need to see:

Masters or PhD or equivalent experience
15+ years of experience building large-scale distributed systems, high-performance storage, or ML systems infrastructure in C/C++ and Python, with a track record of delivering production services.
Deep understanding of memory hierarchies (GPU HBM, host DRAM, SSD, and remote/object storage) and experience designing systems that span multiple tiers for performance and cost efficiency.
Distributed caching or key-value systems, especially designs optimized for low latency and high concurrency.
Hands-on experience with networked I/O and RDMA/NVMe-oF/NVLink-style technologies, and familiarity with concepts like disaggregated and aggregated deployments for AI clusters.
Strong skills in profiling and optimizing systems across CPU, GPU, memory, and network, using metrics to drive architectural decisions and validate improvements in TTFT and throughput.
Excellent communication skills and prior experience leading cross-functional efforts with research, product, and customer teams.

Ways to stand out from the crowd:

Prior contributions to open-source LLM serving or systems projects focused on KV-cache optimization, compression, streaming, or reuse.
Experience designing unified memory or storage layers that expose a single logical KV or object model across GPU, host, SSD, and cloud tiers, especially in enterprise or hyperscale environments.
Publications or patents in areas such as LLM systems, memory-disaggregated architectures, RDMA/NVLink-based data planes, or KV-cache/CDN-like systems for ML.

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our special engineering teams are growing fast. If you're a creative and autonomous engineer with a genuine passion for technology, we want to hear from you!

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 272,000 USD – 431,250 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Why this result? · Employer labels

Keywords also found in description

Location reference: GeoNames (CC BY 4.0), normalized by Referizz.