Senior Software Development Engineer, EC2 Trainium AI Infra
Amazon
- Location
- Onsite (Seattle, Washington)
- Compensation
- $168k - $227k/yr
- Employment
- Full-time
- Level
- Senior Level
Posted 3 days ago
About the Role
Join the EC2 UltraServer Provisioning team at Amazon to lead the technical strategy and design of infrastructure services for AWS Trainium-based AI servers. You will architect large-scale systems and collaborate with cross-functional teams to ensure reliable, high-performance compute infrastructure for AI/ML customers.
Skills
Software development
Infrastructure design
System architecture
Microservices
AWS Trainium
Capacity management
Hardware engineering
Provisioning workflows
Technical leadership
Mentoring
Performance optimization
Reliability engineering
Scalability
Coding standards
Code reviews
Operational excellence
Benefits
- Health insurance
- Dental insurance
- Vision insurance
- 401(k) matching
- Paid time off
- Parental leave
- Life insurance
Perks
- Restricted stock units
- Sign-on payments
Full job details
Are you excited about building the infrastructure that powers the next generation of AI workloads? As a Senior Software Development Engineer on the EC2 UltraServer Provisioning team, you will lead technical strategy, design, and operation of infrastructure services — including provisioning and availability of AWS Trainium-based AI servers. You will architect large-scale systems, build microservices, and collaborate cross-functionally with capacity management, hardware engineering, and datacenter teams to manage AI/ML infrastructure at scale.
Key job responsibilities
- Lead the design and development of infrastructure systems that support AI workloads on UltraServers, ensuring reliability and performance at scale.
- Own your team's architectural direction for provisioning systems, influencing technical decisions across dependent systems and driving alignment with partner teams.
- Collaborate with capacity management, hardware engineering, and datacenter teams to improve provisioning workflows and operate efficiently at scale.
- Mentor and coach engineers on the team, driving adoption of engineering best practices and raising the technical bar across the organization.
- Investigate complex performance challenges, develop solutions, and publish actionable best practices to internal and external stakeholders.
A day in the life
You might start your morning reviewing operational metrics for provisioning pipelines, then shift into a design review with hardware engineering partners on an upcoming server configuration. After lunch, you could be deep in code — prototyping a new microservice or refactoring a critical path in the provisioning workflow. Throughout the day, you balance hands-on technical work with mentoring teammates, unblocking cross-team dependencies, and contributing to architectural decisions that shape how AI infrastructure scales.
About the team
The EC2 UltraServer Provisioning team is responsible for delivering AWS Trainium-based UltraServer infrastructure at scale. We manage end-to-end provisioning workflows from host ingestion through testing, repair, and recovery. Our mission is to ensure that AI/ML customers have reliable, high-performance compute infrastructure ready when they need it. We are a collaborative engineering team that values technical depth, operational excellence, and building systems that grow with customer demand. Basic Qualifications: - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications: - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually
Key job responsibilities
- Lead the design and development of infrastructure systems that support AI workloads on UltraServers, ensuring reliability and performance at scale.
- Own your team's architectural direction for provisioning systems, influencing technical decisions across dependent systems and driving alignment with partner teams.
- Collaborate with capacity management, hardware engineering, and datacenter teams to improve provisioning workflows and operate efficiently at scale.
- Mentor and coach engineers on the team, driving adoption of engineering best practices and raising the technical bar across the organization.
- Investigate complex performance challenges, develop solutions, and publish actionable best practices to internal and external stakeholders.
A day in the life
You might start your morning reviewing operational metrics for provisioning pipelines, then shift into a design review with hardware engineering partners on an upcoming server configuration. After lunch, you could be deep in code — prototyping a new microservice or refactoring a critical path in the provisioning workflow. Throughout the day, you balance hands-on technical work with mentoring teammates, unblocking cross-team dependencies, and contributing to architectural decisions that shape how AI infrastructure scales.
About the team
The EC2 UltraServer Provisioning team is responsible for delivering AWS Trainium-based UltraServer infrastructure at scale. We manage end-to-end provisioning workflows from host ingestion through testing, repair, and recovery. Our mission is to ensure that AI/ML customers have reliable, high-performance compute infrastructure ready when they need it. We are a collaborative engineering team that values technical depth, operational excellence, and building systems that grow with customer demand. Basic Qualifications: - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications: - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually