Software Development Engineer I – AI/ML Network Infrastructure, Annapurna Labs

Amazon's Annapurna Labs is seeking a talented early-career engineer to join their team focused on the network stack for EC2 distributed AI/ML systems. The role involves developing software that supports communication libraries and frameworks for large AI models, while also ensuring the performance of AI workloads in the cloud.

What you'll do:

• Write high-performance C/C++ code for network communication libraries running on custom AWS hardware
• Build and maintain infrastructure that monitors functionality and performance of large-scale AI/ML workloads
• Develop automation using Python and AWS tools (CI/CD, Grafana, Athena) to test, benchmark, and deliver software to customers
• Design mechanisms to detect functional and performance regressions before they reach production
• Work across many instance types, software stacks, and Linux environments

What they're looking for:

• Bachelor's degree or above in Computer Science, Computer Engineering, or related fields
• Strong proficiency in C/C++
• Solid coursework or project experience in: 1/ Operating Systems (Linux internals, kernel concepts, memory management) 2/ Parallel Computer Architecture (multi-threading, SIMD, GPU programming, cache coherence) 3/ Distributed Systems (consensus, message passing, fault tolerance, scalability)
• Familiarity with Linux development environments and toolchains
• Internship experience in ML communications, HPC networking, or RDMA/high-speed interconnects
• Exposure to network programming (sockets, MPI, collective communication patterns)
• Experience with performance profiling and optimization
• Familiarity with GPU programming (CUDA) or hardware-software co-design
• Contributions to open-source projects in systems, networking, or HPC

Benefits:

• Sign-on payments
• Restricted stock units (RSUs)
• Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line)
• Flexible Spending Accounts
• Adoption and Surrogacy Reimbursement coverage
• 401(k) matching
• Paid time off
• Parental leave