• Several years of non-internship professional software development experience
• Several years of programming with at least one software programming language experience
• Several years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team

The Artificial General Intelligence (AGI) team is looking for a highly-skilled Senior Software Engineer, to lead the development and implementation of cutting-edge technologies to push the boundaries of efficient inference for Generative Artificial Intelligence (Gen AI) models.

Key job responsibilities

• Design, develop, test and deploy inference solutions for high-end LLMs
• Explore emerging inference optimization techniques in areas such
• Collaborate with cross-functional teams of engineers and scientists to identify and solve complex problems in Gen AI
• Mentor and guide junior engineers, and contribute to the overall growth and development of the team

A day in the life
Senior engineers in our team are independent and have much freedom in the way they contribute. They read recent papers, explore ideas, brainstorm and freely connect with others to cooperate. They detect, investigate and resolve complex problems, sometimes through creating software solutions, and sometimes just through finding and reusing something that exists. They partner with leaders to focus on right things and make good decisions. They are making sure the team follows best design and programming best practices, as well as lead operational efforts.

About the team
Our mission is to build best-in-class, fast, accurate, and cost-efficient large language model inference solutions and infrastructure that will enable Amazon businesses to deliver more value to their customers.

• Good Experience of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent
• Experience with Python, Py Torch, and C++ programming and performance optimization
• Knowledge of Machine Learning algorithms and techniques
• Experience with Large Language Model inference, especially Tensor RT-LLM and Trainium development
• Excellent problem-solving skills, with the ability to think creatively and critically about complex problems
• Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams

Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy_page) to know more about how we collect, use and transfer the personal data of our candidates.