AI Inference & Training Framework Engineer Intern
NeuroSpark
- Location
- Onsite (Santa Clara, California)
- Employment
- Intern
- Level
- Entry Level
About the role
NeuroSpark is an AI Infrastructure as a Service company seeking an intern to develop and optimize inference and training framework components. The role involves benchmarking performance, integrating models using frameworks like PyTorch or JAX, and debugging real-world AI workloads to scale modern systems.
Skills
Full job details
About the Role
As an AI Inference & Training Framework Intern at NeuroSpark, you will work on systems that run, scale, and optimize modern AI models. Projects may involve model serving, distributed training, scheduling, caching, communication, framework integration, or runtime performance. This internship is a strong fit for students interested in ML systems, distributed systems, or AI infrastructure. Prior full-time industry experience is not required.
What You’ll Do
- Develop and benchmark inference or training framework components.
- Run and integrate models using PyTorch, JAX, vLLM, or related frameworks.
- Analyze latency, throughput, memory usage, and distributed performance.
- Experiment with batching, caching, scheduling, and parallel execution.
- Build multi-GPU inference or training prototypes.
- Develop testing, profiling, and developer tooling.
- Debug performance and correctness issues in real AI workloads.
- Work directly with engineers on production-relevant infrastructure problems.
Minimum Qualifications
- Currently pursuing a Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, or a related field.
- Strong programming ability in Python, C++, or both.
- Coursework or project experience in distributed systems, operating systems, machine learning systems, networking, or parallel computing.
- Familiarity with at least one modern ML framework.
- Comfortable developing in a Linux environment.
- Strong interest in understanding how large-scale AI systems work under the hood.
Preferred Qualifications
- PyTorch, JAX, TensorFlow, vLLM, or SGLang experience.
- Experience running models across multiple GPUs.
- CUDA or GPU programming exposure.
- Familiarity with distributed training or inference.
- Experience with Docker, Kubernetes, cloud infrastructure, or networking.
- Research, personal projects, or open-source contributions related to ML systems.