NVIDIA Logo

NVIDIA

Senior Deep Learning Performance Engineer - Training at Scale

Posted 16 Days Ago
Be an Early Applicant
Remote
5 Locations
Senior level
Remote
5 Locations
Senior level
We seek a Senior Deep Learning Performance Engineer to optimize DL training and inference performance, implementing models across various frameworks and collaborating with teams.
The summary above was generated by AI

We are looking for senior engineers who are mindful of performance analysis and optimization to help us squeeze every last clock cycle out of Deep Learning training, inference and NVIDIA AI Services. We are working across all layers of the hardware/software stack, from GPU architecture to Deep Learning Framework, to achieve peak performance. This role offers an opportunity to directly impact the hardware and software roadmap in a fast-growing company that leads the AI revolution.  Join the team building software used by the entire world. Work with world class software engineers to implement blazingly fast SOTA deep learning models that help understanding the end-to-end performance of NVIDIA’s DL software and hardware stack. Work on most powerful, enterprise-grade GPU clusters capable of hundreds of Peta FLOPS and on unreleased hardware before anyone in the world.

What you’ll be doing:

  • Implement deep learning models from multiple data domains (CV, NLP/LLMs, ASR, TTS, RecSys and others) in multiple DL frameworks (PyT, JAX, TF2, DGL and others)

  • Implement and test new SW features (Graph Compilation, reduced precision training) that use the most recent HW functionalities.

  • Analyze, profile, and optimize deep learning workloads on state-of-the-art hardware and software platforms.

  • Collaborate with researchers and engineers across NVIDIA, providing guidance on improving the design, usability and performance of workloads.

  • Lead best-practices for building, testing, and releasing DL software

What we need to see:

  • 5+ years of experience in DL model implementation and SW Development

  • BSc, MS or PhD degree in Computer Science, Computer Architecture, Mathematics, Physics or related technical field or equivalent experience

  • Excellent Python programming skills, extensive knowledge of at least one DL Framework

  • Strong problem solving and analytical skills

  • Algorithms and DL fundamentals

Ways to stand out from the crowd:

  • Experience in performance measurements and profiling

  • Experience with running large-scale workloads in HPC clusters

  • Knowledge and love for DevOps/MLOps practices for Deep Learning-based product’s development.

  • Solid understanding of Linux environments and containerization technologies such as Docker

  • GPU programming experience (CUDA or OpenCL) is a plus but not required.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and forward-thinking people in the world working for us. If you're creative and autonomous, we want to hear from you! We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Top Skills

Cuda
Dgl
Docker
Jax
Opencl
Python
PyTorch
TensorFlow

Similar Jobs

4 Hours Ago
Remote
Hybrid
GB
Senior level
Senior level
Productivity • Sales • Software
Lead the Reporting team at monday.com, shaping engineering standards and fostering a culture of innovation while delivering impactful solutions.
Top Skills: AWSK8SMySQLNode.jsReactRedisRuby On Rails
4 Hours Ago
Remote
Hybrid
GB
Mid level
Mid level
Productivity • Sales • Software
Lead and mentor a team in feature development, automation, and Agile planning. Drive technical leadership and manage architecture evolution in a collaborative environment.
Top Skills: AWSElasticsearchMySQLNode.jsReactRedisReduxRuby On Rails
4 Hours Ago
Remote
Hybrid
GB
Senior level
Senior level
Productivity • Sales • Software
The Engineering Director will lead the Reporting & Analytics team, develop scalable solutions, and enhance analytics capabilities on the monday.com platform.
Top Skills: AnalyticsEngineering StrategySaaS

What you need to know about the Belfast Tech Scene

If asked to name the birthplace of the RMS Titanic, you might not say Belfast. Similarly, if asked to name Europe's leading destination for foreign direct investment in new software development, Belfast might not come to mind. Yet, both are true. The city has emerged as a tech powerhouse, recently ranked among the best in the U.K. for tech careers — especially for software developers. It also leads the U.K. with the highest percentage of software development jobs advertised.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account