Senior AI Engineer (Remote from Israel)

About this role

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior AI Engineer in Israel.
This role offers the opportunity to design and scale enterprise-grade document intelligence systems powered by self-hosted large language models. You will architect and operate production-ready OCR and LLM pipelines capable of processing complex, long-form documents with deterministic and auditable outputs. As a hands-on technical leader, you will own infrastructure decisions, optimize GPU-backed inference environments, and ensure system reliability at scale. The position combines deep AI engineering with production-grade backend architecture, focusing on performance, governance, and measurable correctness. Working remotely in a highly collaborative environment, you will partner closely with AI leadership while maintaining end-to-end ownership of mission-critical systems.


Accountabilities

• Architecting and implementing end-to-end OCR-heavy pipelines for long-form document processing, including PDF ingestion, layout-aware parsing, segmentation, and metadata tracking.
• Designing scalable systems capable of handling 200+ page documents with high concurrency, performance consistency, and operational stability.
• Integrating and optimizing OCR engines (e.g., Tesseract, PaddleOCR) and layout-aware or vision-language models for structured data extraction.
• Building deterministic validation frameworks, including schema enforcement, rule-based checks, invariant validation, and automated exception routing.
• Deploying and managing self-hosted LLM infrastructure using tools such as vLLM and Hugging Face TGI, including GPU-backed inference services.
• Optimizing inference workloads through batching strategies, KV cache tuning, context window management, and cost-efficiency improvements.
• Implementing robust observability systems with structured logging, tracing, monitoring, and automated recovery mechanisms.
• Ensuring auditability...