AI Engineer
Company: Accuity
Location: United States
Work arrangement: Fully remote
Employment type: Full-time
Experience: 5-10 years
Education: bachelor degree, postgraduate degree
Posted: 2026-11-20
Responsibilities
The AI Engineer develops and operates production-grade AI systems, including intelligent agents, retrieval-augmented generation, and large language models. They are responsible for integrating these systems with internal applications while ensuring reliability, security, and scalability across the clinical documentation ecosystem.
Requirements
Candidates must have a Master's degree in a technical field and at least 5 years of experience in software or AI/ML engineering. Strong proficiency in Python and hands-on experience with LLM applications, RAG solutions, and production-level AI operations are required.
Skills
- Python
- Large Language Models
- Retrieval-Augmented Generation
- AI Agents
- Machine Learning
- Vector Databases
- Knowledge Graphs
- Model Context Protocol
- CI/CD
- Cloud Infrastructure
- Data Architecture
- System Observability
- Prompt Engineering
- API Integration
- Software Engineering
- Security Compliance
About this role
AI Engineer
Department: Technology
Location: Remote
FLSA Status: Exempt
People Leader: No
Travel: Less than 10%
Summary
Company Summary
Accuity partners with hospitals and health systems through a technology-enabled, physician-led model that improves clinical documentation integrity, coding accuracy, reimbursement optimization, and quality outcomes.
Job Summary
The AI Engineer develops and operates the AI systems that support automation across Accuity’s clinical documentation and revenue cycle workflows. Reporting to the Vice President, Data Science and AI, this role builds production services using large language models, intelligent agents, retrieval systems, knowledge graphs, and traditional machine learning.
The AI Engineer owns the technical systems that allow applications to use AI reliably and securely. This includes model integration and adaptation, agent orchestration, retrieval-augmented generation, vector and graph-based knowledge systems, Model Context Protocol services, evaluation pipelines, deployment automation, observability, and production support.
The role works across proprietary and open-source models and selects the appropriate approach for each problem. Depending on the use case, this may involve prompt and context engineering, retrieval, fine-tuning, tool integration, classical machine learning, or a combination of these methods.
The AI Engineer partners with Data Science to move validated approaches into production, Platform Management to use approved infrastructure and delivery pipelines, Data Architecture to access governed data, and application engineering teams to deliver AI capabilities through stable and reusable services.
Success in this role is measured by the reliability, security, maintainability, and measurable workflow impact of the AI systems delivered across the Accuity ecosystem.
Responsibilities
AI and Agent Engineering
Build and maintain production systems using large language models, machine learning models, and intelligent agents.
Develop agent workflows that use tools, retrieval, structured outputs, state, and human approval controls.
Select and adapt models through prompting, retrieval, fine-tuning, or other appropriate techniques.
Integrate AI systems with internal applications, data sources, APIs, and approved external services.
Build reusable AI services with clear, stable interfaces for application teams.
Retrieval and Knowledge Systems
Develop retrieval-augmented generation systems using approved enterprise content and data.
Build and maintain document ingestion, embedding, indexing, search, reranking, and citation pipelines.
Implement vector databases, hybrid search, knowledge graphs, and graph-based retrieval where appropriate.
Maintain data provenance, access controls, and processes for keeping indexed information current.
Measure retrieval quality and correct missing, outdated, duplicated, or irrelevant results.
Model Context Protocol and Tool Integration
Build and maintain Model Context Protocol servers, clients, tools, and resources.
Define secure tool interfaces with clear schemas, permissions, validation, and failure handling.
Connect agents to approved applications, databases, APIs, and business systems.
Apply authentication, authorization, audit logging, and least-privilege access to agent tools.
Develop reusable integrations that can support multiple AI applications.
AI and Machine Learning Operations
Deploy and operate LLMs, agents, retrieval services, and machine learning models in production.
Maintain automated pipelines for testing, versioning, deployment, promotion, retraining, and rollback.
Track versions and lineage across models, prompts, tools, datasets, indexes, and configurations.
Implement monitoring for quality, reliability, latency, usage, and cost.
Investigate production failures and implement lasting corrective actions.
Evaluation, Quality and Security
Build automated evaluation and regression testing for models, prompts, agents, retrieval systems, and tools.
Work with Data Science to convert evaluation methods and production thresholds into release controls.
Test systems against representative, unusual, adversarial, and high-risk scenarios.
Implement safeguards against prompt injection, data leakage, unauthorized tool use, and unsafe outputs.
Ensure AI systems comply with HIPAA, HITRUST, PHI protection requirements, and Accuity policy.
Preserve human review, decision traceability, and audit logging where clinical or coding judgment is involved.
Collaboration and System Ownership
Partner with Data Science to move validated AI approaches into production.
Partner with Platform Management and Data Architecture on infrastructure, deployment, data access, and governance.
Partner with application teams to deliver AI capabilities through reliable and documented services.
Assume ownership of systems delivered by internal teams or external development partners.
Write clean, secure, version-controlled code and maintain documentation that another engineer can use to operate the system.
Communicate system behavior, limitations, risks, and tradeoffs clearly to technical, clinical, and business audiences.
Other Duties as Assigned
• Perform additional responsibilities as needed to support data science, technology, and organizational goals.
Qualifications
Education and Credentials
Master’s degree in computer science, artificial intelligence, machine learning, or a related technical field, or equivalent practical experience, required.
PhD degree in computer science, artificial intelligence, machine learning, or a related field preferred.
Experience
Required Experience
5+ years of experience in software, AI/ML, or platform engineering, including ownership of production systems.
Hands-on experience developing and operating LLM applications, AI agents, and retrieval-augmented generation (RAG) solutions.
Strong Python proficiency, including experience with AI/ML libraries, vector search, tool integration, and human-in-the-loop workfl...
About Accuity
Hospitals and Health Care · 501-1,000 employees · headquartered in Mount Laurel, New Jersey · founded 2016