Find jobs
Pricing
FIND JOBSPRICINGSIGN INSIGN UP
← Back
EM
Embedding Vc

Member of Technical Staff - ML Infrastructure & Performance

Inactive
Location
San Mateo, CA
Work mode
on-site
Type
full-time
Department
Moonlake
Last seen
1d ago
Introducing Moonlake, AI for creating real-time interactive content
Mission: Improve Throughput, Latency, & Cost - deploying our models 2–10× faster & cheaper without quality regressions.
Scope of Work:
•
GPU performance: CUDA/Triton kernels, FlashAttention family, paged attention, CUDA Graphs.
•
Serving stack: TensorRT-LLM/Triton Inference Server, vLLM/TGI; continuous batching; on-GPU KV reuse; speculative decoding/medusa; mixture-of-agents routing.
•
Parallelism: FSDP/ZeRO, TP/PP/expert parallel; NCCL tuning.
•
Quantization/PEFT: AWQ/GPTQ/FP8; LoRA/DoRA serving.
•
Systems: Ray/k8s/Argo, observability (Prom/Grafana/OpenTelemetry), autoscaling, A/B infra, canary + rollback.
Tech signals:
Previous experience at Infra-heavy startups such as Databricks, Roblox
We are committed to being an on-site, in-person team currently based in San Mateo
Seekless
Product
Find jobsPricing
Legal
PrivacyTermsCookies
© 2026 SEEKLESS, INC. ALL RIGHTS RESERVED.BUILT WITH CARE