AI Infrastructure Architect
Accenture
- Location
- Onsite (Bengaluru, Karnataka)
- Employment
- Full-time
- Level
- Senior Level
Posted 2 days ago
About the role
Accenture is seeking an AI Infrastructure Architect to define the vision and reference architecture for large-scale Azure-based AI/ML systems. This role involves leading architectural assessments, optimizing cost-effective compute environments, and mentoring technical teams to deliver scalable, production-ready infrastructure.
Skills
Azure AI Infrastructure
Machine Learning Operations
Azure Kubernetes Service
Azure Machine Learning
Python
Java
C++
Terraform
Kubernetes
Distributed Training
GPU Acceleration
Infrastructure as Code
CI/CD
Model Serving
Observability
Cloud Architecture
Full job details
Project Role : AI Infrastructure Architect
Project Role Description : Architect and build custom Artificial Intelligence (AI) infrastructure/hardware solutions. Optimize AI infrastructure/hardware performance, power consumption, cost and scalability of computational stack. Advise on AI infrastructure technology and vendor evaluation, selection and full stack integration.
Must have skills : Machine Learning Operations
Good to have skills : Microsoft Azure Data Services
Minimum 15 year(s) of experience is required
Educational Qualification : 15 years full time education
Role Summary / Description
AI Powered Tech Talent
As an Technical Architect in AI Infrastructure Architecture, you will act as a senior technical authority for Microsoft Azure-based AI/ML compute infrastructure, shaping the technical vision, reference architecture, standards and implementation strategy for large-scale AI systems. You will evaluate complex choices across compute, networking, storage, orchestration, model serving, observability, security and cost optimization, while guiding senior and lead architects/Technical Architects to deliver resilient, scalable and production-ready AI infrastructure. You will bring industry experience across enterprise AI adoption, compliance, reliability, FinOps and platform modernization to help clients translate AI infrastructure trade-offs into measurable business value.
Key Responsibilities
Set the overarching Azure AI infrastructure vision, strategy and reference architecture for large-scale AI/ML systems, including compute, networking, storage, orchestration, model serving and observability.
Own complex architectural decisions across Azure services such as Azure VMs, Azure Kubernetes Service, Azure Machine Learning, Azure Storage, Azure NetApp Files, Azure Virtual Network, Entra ID, Azure Monitor and Azure DevOps/GitHub Actions, rationalizing options against client standards and business objectives.
Architect and prototype cost-optimized GPU/accelerated compute and distributed training environments, building benchmarks, proof-of-concepts and reusable implementation patterns.
Define architecture standards, reusable infrastructure-as-code patterns, CI/CD approaches, model deployment patterns, monitoring strategy, SLAs/SLOs and cost/performance governance for production AI/ML systems.
Lead architecture assessments and design reviews validate findings through hands-on implementation, profiling, performance tuning and troubleshooting across the AI infrastructure stack.
Evaluate emerging AI infrastructure technologies, accelerators, interconnects, managed AI services and ecosystem tools, and recommend where they belong in enterprise solutions.
Provide executive and client-level technical advisory, translating cloud infrastructure trade-offs into clear, defensible recommendations connected to business outcomes.
Mentor architects and Technical Architects, build community best practices and represent the practice in internal and external technical forums.
Required Qualifications
Bachelor's degree in Computer Science, Computer Technical Architecting, Information Technology or a related Technical Architecting field.
Minimum 6 years of experience coding, building, monitoring, troubleshooting, designing and operating AI/ML infrastructure, cloud platforms, data platforms, model deployment pipelines or large-scale Technical Architecting solutions.
Strong understanding of AI/ML concepts and the compute, infrastructure, orchestration and deployment foundations required to run production AI systems.
Minimum 6 years of proficiency in programming or scripting languages such as Python, Java, C++, Bash, PowerShell or equivalent Technical Architecting languages.
Experience with data pipeline and workflow management tools such as Apache Airflow, Kubeflow, managed orchestration services or platform-native workflow tooling.
Proven experience leading AI infrastructure projects and teams, including technical direction, design reviews, delivery governance and stakeholder alignment.
Strong project management, communication, problem-solving and cross-functional collaboration skills in fast-paced client or enterprise environments.
Demonstrated experience evaluating and selecting AI technologies, frameworks, reference architectures and platform services for production solutions.
Required Skills/ Experience
Expert-level hands-on architecture experience with Azure AI infrastructure services including Azure VMs, AKS, Azure Machine Learning, Azure Storage, Azure Virtual Network, Entra ID, Azure Monitor and Azure DevOps/GitHub Actions.
Deep knowledge of GPU/accelerated compute, distributed training, model serving, container platforms, storage design, network design, observability and resilience Technical Architecting.
Strong experience with Bicep/ARM/Terraform, CI/CD, Docker, Kubernetes, security guardrails, monitoring and infrastructure cost optimization.
Ability to evaluate multiple Azure architecture options and produce standards, patterns, decision records, benchmarks and executive-ready recommendations.
Experience applying MLOps/InfraOps practices for experiment tracking, model registry, deployment automation, monitoring, incident response and rollback strategies.
Good to Have Skills
Azure certifications such as Azure Solutions Architect Expert, Azure DevOps Technical Architect Expert, Azure AI Technical Architect or Azure Data Technical Architect credentials.
Industry experience designing AI infrastructure for BFSI, healthcare, retail/e-commerce, telecom, manufacturing, energy or public sector environments with compliance, security and reliability constraints.
Exposure to LLM infrastructure, vector databases, retrieval pipelines, GPU scheduling, model optimization, high-performance storage and low-latency model serving.
Experience with enterprise architecture governance, technology roadmaps, vendor/partner management, FinOps and production support operating models.
15 years full time education
Project Role Description : Architect and build custom Artificial Intelligence (AI) infrastructure/hardware solutions. Optimize AI infrastructure/hardware performance, power consumption, cost and scalability of computational stack. Advise on AI infrastructure technology and vendor evaluation, selection and full stack integration.
Must have skills : Machine Learning Operations
Good to have skills : Microsoft Azure Data Services
Minimum 15 year(s) of experience is required
Educational Qualification : 15 years full time education
Role Summary / Description
AI Powered Tech Talent
As an Technical Architect in AI Infrastructure Architecture, you will act as a senior technical authority for Microsoft Azure-based AI/ML compute infrastructure, shaping the technical vision, reference architecture, standards and implementation strategy for large-scale AI systems. You will evaluate complex choices across compute, networking, storage, orchestration, model serving, observability, security and cost optimization, while guiding senior and lead architects/Technical Architects to deliver resilient, scalable and production-ready AI infrastructure. You will bring industry experience across enterprise AI adoption, compliance, reliability, FinOps and platform modernization to help clients translate AI infrastructure trade-offs into measurable business value.
Key Responsibilities
Set the overarching Azure AI infrastructure vision, strategy and reference architecture for large-scale AI/ML systems, including compute, networking, storage, orchestration, model serving and observability.
Own complex architectural decisions across Azure services such as Azure VMs, Azure Kubernetes Service, Azure Machine Learning, Azure Storage, Azure NetApp Files, Azure Virtual Network, Entra ID, Azure Monitor and Azure DevOps/GitHub Actions, rationalizing options against client standards and business objectives.
Architect and prototype cost-optimized GPU/accelerated compute and distributed training environments, building benchmarks, proof-of-concepts and reusable implementation patterns.
Define architecture standards, reusable infrastructure-as-code patterns, CI/CD approaches, model deployment patterns, monitoring strategy, SLAs/SLOs and cost/performance governance for production AI/ML systems.
Lead architecture assessments and design reviews validate findings through hands-on implementation, profiling, performance tuning and troubleshooting across the AI infrastructure stack.
Evaluate emerging AI infrastructure technologies, accelerators, interconnects, managed AI services and ecosystem tools, and recommend where they belong in enterprise solutions.
Provide executive and client-level technical advisory, translating cloud infrastructure trade-offs into clear, defensible recommendations connected to business outcomes.
Mentor architects and Technical Architects, build community best practices and represent the practice in internal and external technical forums.
Required Qualifications
Bachelor's degree in Computer Science, Computer Technical Architecting, Information Technology or a related Technical Architecting field.
Minimum 6 years of experience coding, building, monitoring, troubleshooting, designing and operating AI/ML infrastructure, cloud platforms, data platforms, model deployment pipelines or large-scale Technical Architecting solutions.
Strong understanding of AI/ML concepts and the compute, infrastructure, orchestration and deployment foundations required to run production AI systems.
Minimum 6 years of proficiency in programming or scripting languages such as Python, Java, C++, Bash, PowerShell or equivalent Technical Architecting languages.
Experience with data pipeline and workflow management tools such as Apache Airflow, Kubeflow, managed orchestration services or platform-native workflow tooling.
Proven experience leading AI infrastructure projects and teams, including technical direction, design reviews, delivery governance and stakeholder alignment.
Strong project management, communication, problem-solving and cross-functional collaboration skills in fast-paced client or enterprise environments.
Demonstrated experience evaluating and selecting AI technologies, frameworks, reference architectures and platform services for production solutions.
Required Skills/ Experience
Expert-level hands-on architecture experience with Azure AI infrastructure services including Azure VMs, AKS, Azure Machine Learning, Azure Storage, Azure Virtual Network, Entra ID, Azure Monitor and Azure DevOps/GitHub Actions.
Deep knowledge of GPU/accelerated compute, distributed training, model serving, container platforms, storage design, network design, observability and resilience Technical Architecting.
Strong experience with Bicep/ARM/Terraform, CI/CD, Docker, Kubernetes, security guardrails, monitoring and infrastructure cost optimization.
Ability to evaluate multiple Azure architecture options and produce standards, patterns, decision records, benchmarks and executive-ready recommendations.
Experience applying MLOps/InfraOps practices for experiment tracking, model registry, deployment automation, monitoring, incident response and rollback strategies.
Good to Have Skills
Azure certifications such as Azure Solutions Architect Expert, Azure DevOps Technical Architect Expert, Azure AI Technical Architect or Azure Data Technical Architect credentials.
Industry experience designing AI infrastructure for BFSI, healthcare, retail/e-commerce, telecom, manufacturing, energy or public sector environments with compliance, security and reliability constraints.
Exposure to LLM infrastructure, vector databases, retrieval pipelines, GPU scheduling, model optimization, high-performance storage and low-latency model serving.
Experience with enterprise architecture governance, technology roadmaps, vendor/partner management, FinOps and production support operating models.
15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.