Agent Operations Lead
Digital Staff Operations Lead (remote)
About Quantrim
Quantrim’s digital staff are AI agents hired to do work: Mary in sales, Adam in operations, Eliza in strategy. They are paid on results you can verify: a proven sale, a task completed and checked, a brief delivered. That model works only if someone owns every agent after go-live. That is you.
The role
You run our digital staff in production across our clients. You watch performance every day, keep the outcome numbers clean, fix what drifts and improve each agent every month. When an agent gets something wrong, you are the first call and the one who puts it right.
What you’ll do
- Own the live roster of digital staff: health, volume, accuracy and escalations.
- Set up the outcome measures and attribution rules before each free trial, and keep them clean. They are what we bill on.
- Build evaluations and monitoring that catch drift, bad answers and broken integrations before a client does.
- Review conversations and task logs weekly, and turn what you find into prompt, workflow or data fixes.
- Run incidents: pause the agent, tell the named owner, fix it and write the record, as our Guardrails Framework requires.
- Report to each client monthly: what the agent did, what it returned, what changes next.
- Work with our implementation and Digital Brain engineers on fixes that need a build.
What we’re looking for
- 3+ years in production operations: support or solutions engineering, SRE, RevOps or a forward deployed role.
- Hands-on with LLM agents in production: evals, tracing, prompt and tool changes.
- Enough SQL or Python to answer “did the agent really make this sale?” with evidence.
- Calm under pressure, and plain with clients when something has gone wrong.
- Bonus: the CRM, e-commerce and ERP platforms Australian businesses run, or tools such as Langfuse, LangSmith or Datadog.
Why join Quantrim?
- You hold the number we get paid on. Few operations roles sit this close to revenue.
- Many real agents in real businesses, not one product.
- A say in the tooling and the playbook every deployment runs on.
- 100% remote, Australian time zones, small senior team.
Compensation & benefits
- Competitive base + performance incentives linked to client outcomes.
- Flexible schedule, remote work, and rapid growth opportunities.
- Access to cutting-edge AI infrastructure and tools.
Apply & Register Your Interest
Send us your LinkedIn profile, a link to your work if you have one, and a short note on an AI system you kept running in production, and the worst thing that went wrong with it.
We review applications every week and reply to everyone within two weeks. We keep your application on file for 12 months and look there first when a role opens.
Thanks. We’ve got it
We review applications every week, so you’ll hear from us within two weeks. We keep your details on file for 12 months for future roles.