Career EngineCareer Engine
Your matchExample
87%match
Why you fitThis role calls for Llm Inference and Pytorch — tell us what you know and we'll check the rest.
Gap to noteAlso lists Cuda — worth confirming before you apply.

Get roles like this, scored and matched, in your inbox.

Sign up free →

Job Opening

Nio Inc. logo

AI Infrastructure Engineer

Nio Inc. · San Jose-US · Posted 109 days ago

$192k–$250kic
LLM InferencePyTorchCUDAC++GPU ProgrammingTensor ParallelismModel OptimizationKernel Development

We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference systems. This position is focused on designing, implementing, and delivering production-grade software that powers real-world applications of Large Language Models (LLMs) and Vision-Language Models (VLMs).

This is an exciting opportunity for an engineer who thrives at the intersection of AI systems, hardware acceleration, and large-scale robust deployment, and who wants to see their contributions ship in production, at scale.

In this role, you will directly shape the architecture, roadmap and performance of AI capabilities of our AIOS platform, driving innovations that make LLM/VLM systems fast, efficient, and scalable across cloud, edge, and hybrid edge-cloud environments. You will work closely with system, hardware, and product teams to deliver high-performance inference kernels for hardware accelerators, design scalable inference serving systems, and integrate optimizations such tensor parallelism and custom kernels into production pipelines. Your work will have immediate impact, powering intelligent automotive systems in the next generation of electric vehicles.

Roles and Responsibilities :

…

Apply on Nio Inc.'s site →

This posting is sourced from Nio Inc.'s own career site — applying takes you there directly.

Get roles like this, scored and matched, in your inbox.

Sign up free →

Related roles

This role centers on Llm Inference, Pytorch, Cuda, and C++. There are 18 open roles at Nio Inc. right now.

Want roles like this found for you?

Set your Focus once. Career Engine screens every new opening every week.

A scored, explained shortlist — not a keyword match — delivered weekly. Free for one profile.