d_model is a fundamental AI research lab partnering with frontier labs to turn their models into capable interpretability and alignment researchers. Alongside our partnerships, we aim to use the agents we build for independent research.
Our team brings experience from places including OpenAI, Google, Anthropic, EleutherAI, and MATS.
About the Role:
As a Member of Technical Staff, you’ll build the reinforcement learning environments and evaluations we use to study how AI agents approach alignment problems. This role is a strong fit for someone early in their research career who wants hands-on experience in AI safety, interpretability, and reinforcement learning.
Primary Responsibilities:
•
Build reinforcement learning environments and evals to test how AI agents approach alignment problems
•
Develop graders robust to specification gaming
•
Find novel interpretability and alignment techniques
•
Present findings in team research meetings and contribute to papers in ML
•
Run experiments and identify patterns in model behavior and failure modes
•
Investigate AI Interpretability techniques within our reinforcement learning environments
You May Be a Good Fit If You:
•
Have strong proficiency in Python and ML frameworks (PyTorch or JAX)
•
Are able to iterate quickly and collaboratively
•
Are familiar with the alignment and/or interpretability literature
•
Can generate research ideas in the field and implement others’ ideas
Strong Candidates May Also Have:
•
Published or presented research in AI safety, especially Mechanistic Interpretability
•
Graduate degree in physics or mathematics, or equivalent research experience
•
Academic research experience
•
Experience post-training language models
What We Offer:
•
Health, vision, and dental benefits
•
Flexible PTO policy
•
Catered breakfast and lunch
•
Monthly workspace and wellness allowances
•
Commuter benefits
•
Free SFMOMA admission and group subscriptions to Works in Progress, The New Yorker, Eye, and Aesthetica
Logistics:
Location Policy: Currently, we expect all staff to be in office 5 days a week in our San Francisco location.
Visa Sponsorship: We sponsor visas. Not every role and candidate combination works out, but when we make an offer we commit to a genuine effort, supported by an immigration counsel we work with directly.
Compensation: $150,000-$225,000 + bonus + equity
We encourage you to apply even if you don’t believe you meet every single qualification.