Senior Software Engineer, AI Platform

Responsibilities

You will build and operate the agent orchestration layer, including model routing, memory, and guardrails for AI agents. Additionally, you will manage agent lifecycles through CI/CD and build evaluation infrastructure to ensure safe and effective production deployments.

Requirements

Candidates must have a bachelor's degree in Computer Science or a related field and at least 6 years of software engineering experience. You must also have 2+ years of experience building LLM-powered systems in production and strong proficiency in Python.

Skills

• Python
• LLM
• AWS
• CI/CD
• Infrastructure as code
• Multi-agent systems
• CrewAI
• LangGraph
• RAG
• MCP
• Observability
• System architecture
• Data redaction
• Technical leadership
• Mentoring
• Probabilistic systems

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• 20 vacation days per year
• 9 federal holidays
• Parental leave
• Pre-tax 401k contribution
• HSA
• Health advocate
• Telehealth membership
• OneMedical account

About this role

About Kinetic 

We’re transforming workers’ comp with technology-driven solutions for injury
prediction, prevention, and management—helping employers create safer, healthier
workplaces.

Our platform is built for labor intensive industries including parcel delivery,
manufacturing, and wholesale/warehousing operations. Our tech-driven program
speeds up return-to-work and offers generative AI for claims management. Through
these and other products and services, we're redefining what workers' comp can
do.

We’re a remote-first team headquartered in New York City, growing fast—10x in
the past two years—and driven by accountability, continuous improvement, and
collaboration. If you're excited to build a career with impact, we’d love to
meet you.

Kinetic has been named to: Business Insurance's Best Place to Work in Insurance
2025 & 2026.

ABOUT THE ROLE

As a Senior Software Engineer on our AI Platform team, you'll build and enhance
the platform every Kinetic AI agent runs on. We are building agents across the
insurance lifecycle, from broker submissions to underwriting to claims. You'll
own the orchestration layer, tools, evaluation infrastructure, and guardrails
behind every agent. With that platform in place, we can release an agent safely,
measure whether it improved a real business result, and quickly undo a change
that doesn't work.

This is a hands-on, senior individual contributor role. You'll write production
code every day, set technical direction for agent infrastructure, and partner
with our product and platform development teams as they build on this AI
platform. You'll report to our Tech Lead - Data & AI.

WHAT YOU'LL DO

* Build and operate Kinetic's agent orchestration layer: model routing, tools,
memory, permissions, and guardrails, kept portable across frameworks and
model providers.
* Manage agents like code, with prompts, tools, and model versions shipped
through CI/CD, tracked for cost and latency, and easy to roll back.
* Build MCP servers and other tools that give agents secure access to
Salesforce, Athena, and claims data, with PHI and PII redaction and full
audit logs.
* Build the evaluation harness and rollout gates that test every change against
golden datasets before it reaches production.
* Build human-in-the-loop checkpoints for critical decisions that always need a
person.
* Replatform or retire the one-off AI scripts and workflows already in use.
* Set standards, review agent designs and code, and mentor engineers building
agents across Kinetic.
* Evaluate when to use or not use AI, and when to buy vs. build new systems and
components.

WHAT YOU BRING

* Bachelor's degree in Computer Science or a related field, and 6+ years of
software engineering experience.
* 2+ years building LLM-powered systems in production, not just demos.
* Strong Python on serverless (AWS preferred), plus infrastructure as code and
CI/CD.
* Hands-on experience building multi-agent systems with CrewAI or other agent
frameworks such as LangGraph, OpenAI Agents SDK, Google ADK, or AWS Bedrock
AgentCore, including tool calling, structured outputs, RAG, and MCP.
* Built evaluation and observability for LLM systems, such as golden datasets,
automated graders, and tracing.
* Clear communicator who can explain probabilistic systems to business
partners.

NICE TO HAVES

* Experience at an insurtech, MGA, or carrier, or in another regulated industry
such as healthcare or financial services, ideally with workers' compensation,
underwriting, or claims workflows.
* Shipped systems that handle sensitive data under HIPAA, SOC 2, or similar
requirements.
* Experience with Salesforce, data lakes such as Athena, and multi-model cost
optimization.
* Experience with OpenTelemetry or similar tracing for LLM systems.
* Experience in startups or high-growth environments, building from scratch.

What we offer
* Fully distributed, remote team across all continental US time zones
* Medical, dental, and vision insurance
* 20 vacation days per year
* 9 federal holidays off 
* Parental Leave
* Pre-tax 401k contribution
* HSA with compatible health plans
* FREE: Health Advocate
* FREE: Telehealth Membership
* FREE: OneMedical Account

Note
Candidates must reside within the US with existing authorization to work in the
United States. This role requires domestic travel for company offsites and team
alignment. Verification of government-issued identity and employment eligibility
will be conducted in person prior to employment.

Security Notice: Kinetic is committed to a secure hiring process. All offers of
employment are contingent upon successful completion of a comprehensive identity
and background verification process. We will never ask for financial information
or payment during the application process.

About Kinetic

Insurance · 51-200 employees · headquartered in New York, NY · founded 2014