Senior Software Engineer / Data Engineer – Cyber Threat Intelligence Collections

About this role

About the Role

We are looking for a Senior Software Engineer / Data Engineer to join our Threat Intelligence Collections team. You will design, build, and operate large-scale data collection systems that gather, enrich, and deliver high-fidelity threat intelligence from the open web, deep web, and dark web sources. This is a high-impact, technically challenging role at the intersection of cybersecurity, data engineering, and modern AI-driven automation.

You will own the full lifecycle of threat data pipelines — from raw source ingestion to clean, structured, and queryable intelligence that powers our detection, hunting, and response capabilities.

Key Responsibilities

• Design and scale high-volume data collection systems that ingest threat data from open-web, deep-web, and dark-web sources (including Tor, I2P, and other anonymity networks).
• Build and maintain robust, fault-tolerant data pipelines (batch + streaming) for ingestion, transformation, enrichment, and storage.
• Develop advanced data parsing and normalization logic for unstructured, semi-structured, and rapidly evolving threat data formats
• Design, build, and maintain agentic workflows — autonomous, LLM-powered agents that can reason, adapt, and execute multi-step collection and enrichment tasks.
• Architect and operate high-scale media pipelines for ingesting, processing, storing, and enriching large volumes of media content (images, videos, screenshots, documents, etc.) collected from threat intelligence sources.
• Design and build internal and external APIs that expose collected intelligence to downstream security teams and platforms.
• Write clean, production-grade Python code as the primary language for all data engineering and automation work.
• Collaborate closely with threat intelligence analysts, detection engineers, and security researchers to translate intel requirements into reliable, scalable data systems.
• Monitor, troubleshoot, and continuously optimize collection pe...