Senior II Software Engineer Lead - Akamai Inference Cloud
Company: Akamai Technologies
Location: Campbell
Posted on: January 8, 2026
|
|
|
Job Description:
The Akamai Inference Cloud team is part of Akamais Cloud
Technology Group. We design, implement, deploy and operate AI
platforms that enable customers to run inference models and
developers to create AI applications with unmatched performance,
compliance, and economics. As a Senior II Software Engineer Lead,
you will be responsible for driving the design and implementation
of critical components of our globally distributed AI inference
platform. Youll work hands-on to build and optimize systems that
deliver OpenAI-compatible endpoints while orchestrating inference
workloads across regions. You will guide other engineers, influence
technical direction, and ensure delivery of high-quality, scalable
solutions. As a Senior II Software Engineer Lead, you will be
responsible for: • Leading the design and implementation of
critical platform components for Akamai Inference Cloud, ensuring
performance, scalability, and reliability • Driving technical
decisions for your domain, selecting appropriate tools, frameworks,
and approaches for AI inference workloads • Mentoring and guiding
engineers on the team through code reviews, design discussions, and
technical problem-solving • Implementing and optimizing
containerized AI workloads with hardware-specific optimizations and
integrating inference frameworks at scale • Collaborating across
teams to define technical requirements, contribute to platform
standards, and ensure operational excellence Do what you love To be
successful in this role you will: • 8 years of relevant experience
and a Bachelors degree or its equivalent • Have solid proficiency
in distributed systems, cloud services, and platform engineering •
Demonstrate hands-on experience with AI inference, model serving,
or LLM deployment with working knowledge of inference frameworks
(TensorRT, vLLM, TorchServe, Triton) • Show expertise in
containerization and orchestration technologies including
Kubernetes, Docker, and cloud-native architectures • Have proven
experience building scalable, high-performance systems with modern
DevOps practices, CI/CD pipelines, and infrastructure-as-code •
Demonstrate solid technical leadership through mentoring, code
quality advocacy, and ability to drive technical solutions for
complex problems • Show familiarity with API design and
development(REST/gRPC patterns), GPU infrastructure and hardware
acceleration • Have knowledge of observability, monitoring, and
debugging distributed systems Work in a way that works for you
FlexBase, Akamais Global Flexible Working Program, is based on the
principles that are helping us create the best workplace in the
world. When our colleagues said that flexible working was important
to them, we listened. We also know flexible working is important to
many of the incredible people considering joining Akamai. FlexBase,
gives 95% of employees the choice to work from their home, their
office, or both (in the country advertised). This permanent
workplace flexibility program is consistent and fair globally, to
help us find incredible talent, virtually anywhere. We are happy to
discuss working options for this role and encourage you to speak
with your recruiter in more detail when you apply.
Keywords: Akamai Technologies, Palo Alto , Senior II Software Engineer Lead - Akamai Inference Cloud, IT / Software / Systems , Campbell, California
