Machine Learning - Model Serving Job at Alexander Chapman, Fremont, CA

bnVpekkvV3JuS05CUGd2YkY0dWw4UHRxd1E9PQ==
  • Alexander Chapman
  • Fremont, CA

Job Description

We are working with a company building intuitive, voice-first AI systems that blend natural interaction with powerful model performance. Founded by leaders from Meta, Oculus, and Google, they’re creating a new class of consumer devices powered by speech, vision, and LLMs.

The Role

You’ll help optimize and scale the inference stack, working across model serving, performance tuning, and deployment to support real-time, multimodal AI.

What You’ll Do

  • Improve serving systems for LLMs, speech, and vision models.
  • Optimize throughput, latency, and cost using advanced techniques like batching, caching, and kernel tuning.
  • Extend frameworks like VLLM or SGLang to push the limits of performance.
  • Collaborate with training teams to deploy faster, lighter models.
  • Experiment with compilers and hardware backends to boost efficiency.

What We’re Looking For

  • Strong experience with PyTorch or similar ML frameworks.
  • Deep knowledge of model serving and systems performance.
  • Skilled in low-level debugging, bottleneck analysis, and server optimization.
  • Familiar with VLLM, Ray, or deploying inference workloads at scale.
  • Comfortable owning complex infrastructure projects end to end.
  • Background in computer science or related field from a top-tier university (e.g. Stanford, MIT, Ivy League).
  • Experience at a top tech company (e.g. FAANG) or a successful, high-growth startup.

They’re looking for curious, impact-driven engineers ready to push what’s possible with real-time AI.

Job Tags

Similar Jobs

Unity Baptist Church-Culpeper

Church Musician-Culpeper, Va Job at Unity Baptist Church-Culpeper

 ...only from Unity and leadership but members of the congregation and music ministry Ability to organize, coordinate, and motivate musicians Strong team player who possesses a willingness to work with the rest of the Unity leadership Dependable, responsible, and... 

Safe Horizon, Inc.

Crime Victim Advocate - Queens Job at Safe Horizon, Inc.

 ...supportive listening Advocate with NYPD personnel that may include keeping a victim apprised of an NYPD investigation Provide criminal justice advocacy Advocate for victims for public benefits they may be entitled to Help with applying for compensation through... 

RPG

Entry Level Marketing Associate Job at RPG

Entry Level Marketing Associate - Join the Clean Energy Revolution Are you a people person with a passion for sustainability? Were hiring Entry Level Marketing Associates to represent solar and battery storage solutions at major home improvement retailers. Help homeowners... 

Sun Mechanical Contracting, Inc.

6G Pipe Welder/ Shop Fabricator Job at Sun Mechanical Contracting, Inc.

 ...Quality Service. Quality Product. Quality People. As one of the largest mechanical contractors in the Southwest, Sun Mechanical fabricates, installs and maintains mechanical systems for hospitals, laboratories, universities, hotels, manufacturers, public utilities,... 

Robert Half

Dispatcher Job at Robert Half

 ...Job Description Job Description We are looking for a highly organized Scheduler/Dispatcher to join an organization in downtown Columbus. In this Contract-to-Permanent position, you will play a critical role in coordinating interpreter services for hospitals, courts...