ByteDance
San Jose, CA

Software Engineer Graduate (AI Infra Compute) - 2027 Start

Onsite$128,000 - $256,000/yrPosted todayVisa Sponsorship

We tailor your resume to this role and apply for you in seconds.

Apply to Software Engineer Graduate (AI Infra Compute) - 2027 Start at ByteDance

Job details

Location
San Jose, CA
Work type
Onsite
Compensation
$128,000 - $256,000/yr
Visa
Sponsorship available
Posted
today
Apply on
joinbytedance.com

About this role

ByteDance is a company founded in 2012 with a mission to inspire creativity and enrich life. They are seeking a Graduate Software Engineer to join their Compute division, focusing on building large-scale cloud infrastructure and optimizing AI technologies.

What you'll do:

  • Develop key technologies to optimize our AI Infra stack, including training infra, inference infra, and AI agents
  • Work with academia and open source communities on joint development
  • Follow the latest technologies from academia or industry and conduct deep-dive analysis
  • Present our research and products in academic papers

What they're looking for:

  • Individuals who are completing or have recently completed a Master's degree in Computer Science, Computer Engineering, or a related discipline
  • Experience with at least one of the following areas: LLM training infra, including optimizations for various post-training workloads such as RL training, knowledge distillation, etc
  • Experience with at least one of the following areas: LLM inference infra, including inference engine performance improvements, more efficient execution parallelism, GPU kernel optimizations, etc
  • Experience with at least one of the following areas: AI Agent Infra, including computer-use agents, coding agents, agent memory, agent sandbox, etc
  • Commit to proactive continuous learning, demonstrate enthusiasm for AI technologies, and exhibit a strong ability to quickly grasp and apply new technologies
  • Good communication and teamwork skills
  • Frequent contributors or maintainers in AI Infra related open source communities such as vLLM or SGLang
  • Having CS conference publications such as OSDI or MLSys

Benefits:

  • Employees have day one access to medical, dental, and vision insurance
  • A 401(k) savings plan with company match
  • Paid parental leave
  • Short-term and long-term disability coverage
  • Life insurance
  • Wellbeing benefits
  • Employees also receive 10 paid holidays per year
  • 10 paid sick days per year
  • 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Ready to apply to ByteDance?
We tailor your resume to this role and apply for you.

About ByteDance

ByteDance
San Jose, CA