Apache NiFi Data Platform Engineer

About this role

Join our team as an Apache NiFi Engineer and play a vital role in designing, deploying, and maintaining high-performance data pipelines that power real-time analytics and industrial IoT solutions. You'll be responsible for managing, securing, and troubleshooting NiFi clusters, optimizing data flows, and ensuring system reliability across complex environments involving IoT devices, SCADA systems, and big data platforms. With your expertise in data integration, industrial protocols, scripting, and system monitoring, you'll help deliver scalable, secure, and efficient data solutions that drive innovation and operational excellence.


Technical Requirements For Apache NiFi Resource

• Strong understanding of Apache NiFi:

• Experience designing, developing, and deploying data flows using NiFi.
• Knowledge of NiFi processors, controller services, templates, and reporting tasks.
• Ability to configure and optimize NiFi for performance and reliability.

• Data Integration and ETL skills:

• Experience with data ingestion, transformation, routing, and system integration.
• Familiarity with common data formats (JSON, XML, CSV, Avro, Parquet).
• Understanding of batch and real-time data processing concepts.

• IoT Data Processing with NiFi:

• Experience ingesting and processing IoT data from industrial sensors, PLCs (Programmable Logic Controllers), SCADA systems, and other ICS devices.
• Familiarity with industrial communication protocols such as MQTT, OPC-UA, Modbus, DNP3, and Ethernet/IP.
• Ability to design NiFi flows for real-time telemetry data collection, anomaly detection, filtering, enrichment, and routing within ICS environments.
• Handling high-volume, time-sensitive data streams with strict latency and reliability requirements.
• Integration with industrial IoT platforms, historians, time-series databases, and analytics/monitoring tools.
• Understanding of ICS-specific security concerns, including network segmentation, secure communication (TLS), an...