[Remote] Apache NiFi Data Platform Engineer
Note: The job is a remote job and is open to candidates in USA. OP is a technology consulting and solutions company that offers innovative platforms and staffing solutions. They are seeking an Apache NiFi Engineer to design, deploy, and maintain high-performance data pipelines for real-time analytics and industrial IoT solutions, ensuring system reliability and optimizing data flows.ResponsibilitiesJoin our team as an Apache NiFi Engineer and play a vital role in designing, deploying, and maintaining high-performance data pipelines that power real-time analytics and industrial IoT solutionsYou'll be responsible for managing, securing, and troubleshooting NiFi clusters, optimizing data flows, and ensuring system reliability across complex environments involving IoT devices, SCADA systems, and big data platformsWith your expertise in data integration, industrial protocols, scripting, and system monitoring, you'll help deliver scalable, secure, and efficient data solutions that drive innovation and operational excellenceParticipate in OP monthly team meetings and participate in team-building effortsContribute to OP technical discussions, peer reviews, etcContribute content and collaborate via the OP-Wiki/Knowledge BaseProvide status reports to OP Account Management as requestedSkillsStrong understanding of Apache NiFiExperience designing, developing, and deploying data flows using NiFiKnowledge of NiFi processors, controller services, templates, and reporting tasksAbility to configure and optimize NiFi for performance and reliabilityExperience with data ingestion, transformation, routing, and system integrationFamiliarity with common data formats (JSON, XML, CSV, Avro, Parquet)Understanding of batch and real-time data processing conceptsExperience ingesting and processing IoT data from industrial sensors, PLCs (Programmable Logic Controllers), SCADA systems, and other ICS devicesFamiliarity with industrial communication protocols such as MQTT, OPC-UA, Modbus, DNP3, and Ethernet/IPAbility to design NiFi flows for real-time telemetry data collection, anomaly detection, filtering, enrichment, and routing within ICS environmentsHandling high-volume, time-sensitive data streams with strict latency and reliability requirementsIntegration with industrial IoT platforms, historians, time-series databases, and analytics/monitoring toolsUnderstanding of ICS-specific security concerns, including network segmentation, secure communication (TLS), and role-based access controlProficiency in scripting languages such as Groovy, Python, or Shell for custom processors or extensionsKnowledge of Java is a plus for developing custom NiFi processorsExperience with Kafka, Hadoop, Spark, or other big data ecosystems is beneficialUnderstanding of messaging systems and streaming data pipelinesFamiliarity with Linux/Unix environments where NiFi typically runsUnderstanding of networking concepts, security (SSL/TLS), and authentication mechanismsAbility to monitor NiFi flows, troubleshoot issues, and optimize resource usageExperience with NiFi logs, provenance data, and metricsExperience with Git or other version control systemsFamiliarity with CI/CD pipelines for deploying NiFi flowsStrong problem-solving and analytical skillsGood communication skills to collaborate with data engineers, architects, and stakeholdersBenefits401(k).Dental Insurance.Health insurance.Vision insurance.Company OverviewOP is one of the fastest-growing technology consulting and solutions companies in the U.S. It was founded in 2006, and is headquartered in Irvine, California, USA, with a workforce of 201-500 employees. Its website is http://www.orangepeople.com/.Company H1B SponsorshipOP has a track record of offering H1B sponsorships, with 8 in 2025, 5 in 2024, 1 in 2023, 8 in 2022, 6 in 2021, 11 in 2020. Please note that this does not guarantee sponsorship for this specific role.