System Software Engineer, Conversational AI

System Software Engineer
Pune
February 1, 2024
Full Time
Apply Now

Job Description

Batch – 2021 & earlier

NVIDIA’s technology is at the heart of the AI revolution, touching people across the planet by powering everything from self-driving cars, robotics, and intelligent assistants. Come join the team and see how you can make a lasting impact on the world! We’re looking to grow our company, and build our teams with the smartest people in the world. Join us at the forefront of technological advancement. NVIDIA is looking for a System Software Engineer to develop tools for building powerful, flexible, multi-modal AI agents driven by Large Language Models(LLM) & improve the experience of millions of customers. If you’re creative & passionate about solving real world conversational AI problems, come join us.

Check CS FOR ALL Mentorship Program here – https://csforall.in/mentorshipprogram/

What you’ll be doing:

  • Build GPU accelerated scalable LLM driven Retrieval Augmented Generation(RAG) workflow and build a scalable microservice based architecture deployable on multi-node, multi-cloud environment
  • Build domain specific agents and workflows and build a framework which can support multi-turn, multi-modal, multi-user conversations with a LLM driven agents.
  • Develop knowledge discovery, and reasoning capabilities including but not limited to disambiguation, clarification, and anticipation for dialogue systems
  • Evaluate and benchmark end to end RAG and conversational AI agent pipelines for accuracy as well as system performance
  • Analyze RAG and conversational AI agent end to end accuracy and limitations and recommend the next course of action & Improvements.
  • Characterize performance and quality metrics across platforms for various AI and system components
  • Collaborate with various teams on new product features and improvements of existing products. Customize and integrate the conversational AI framework with other NVIDIA products
  • Participate in developing and reviewing code, design documents, use case reviews, and test plan reviews and help innovate, identify problems, recommend solutions and perform triage in a collaborative team environment.

What we need to see:

  • Bachelor’s degree or Master’s degree (or equivalent experience) in Computer Science, Electrical Engineering, Artificial Intelligence, or Applied Math
  • 2+ years of experience
  • Excellent programming skills in Python
  • Knowhow of Large Language model applications
  • Experience of working on end to end Software lifecycle, release packaging & CI/CD pipeline
  • Hands-on experience on conversational AI Technologies like Large Language Models, Information Retrieval, Natural Language Processing, Dialogue systems (including system integration, state tracking and action prediction), Question and Answering, etc.
  • General background around version control and code review tools like Git, Gerrit, Gitlab.

Ways to stand out from the crowd:

  • Strong fundamentals in Programming, optimizations and Software design
  • Strong knowledge of ML/DL techniques, algorithms and tools with exposure to Transformers (BERT, GPT, Megatron), Language Models
  • Know how of vector databases and embedding models
  • Familiarity with GPU based technologies like CUDA, CuDNN and TensorRT
  • Background with deploying machine learning models on data center, cloud, and embedded systems

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression , sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Check CS FOR ALL Mentorship Program here – https://csforall.in/mentorshipprogram/