AI Infra Engineer Intern (Recommendation & LLM) - 2027 Summer

TikTok is a short-form mobile video platform focused on inspiring creativity and bringing joy. The AI Infra Engineer Intern will build and optimize infrastructure for large-scale recommendation models and LLM training and inference, including distributed systems, GPU computing, and performance optimization.

What you'll do:

• Build and optimize infrastructure for large-scale model training and online inference
• Develop distributed systems supporting large recommendation models and LLMs
• Improve training and inference performance through GPU optimization and efficient communication
• Collaborate with researchers to develop and deploy LLM training and serving solutions
• Analyze system bottlenecks and implement performance optimizations

What they're looking for:

• • Currently pursuing a Bachelor's degree in Computer Science or a related discipline
• • Strong programming skills in C++ or Python
• • Good understanding of data structures, algorithms, and computer systems
• • Familiarity with PyTorch or TensorFlow
• • Knowledge of Transformer architectures and Large Language Models (LLMs)
• • Strong problem-solving skills and a passion for building large-scale AI systems
• • Currently pursuing a Master's degree in Computer Science or a related discipline
• • Hands-on experience with LLM training or inference through research, internships, or open-source projects
• • Familiarity with distributed training concepts (e.g., DP, TP, PP, FSDP, ZeRO)
• • Experience with GPU programming using CUDA, Triton, or similar technologies
• • Understanding of LLM serving techniques such as KV Cache, Continuous Batching, or FlashAttention
• • Contributions to open-source projects or research in machine learning systems, distributed systems, or LLM infrastructure

Benefits:

• Interns have day one access to health insurance, life insurance, wellbeing benefits and more.
• Interns also receive 10 paid holidays per year and paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year).
• Interns who are not working 100% remote may also be eligible for housing allowance.
• Internship program offers students hands-on experience, industry exposure, and opportunities to apply their knowledge to real-world challenges while building a strong foundation for personal and professional growth.
• Interns will gain practical experience, explore potential career paths, and participate in social events, learning programs, and development workshops alongside industry professionals.