Data Engineer / Architect III USC and GC - W2 Role

Position Summary

Seeking a highly skilled Data Engineer / Architect III to support enterprise-scale data integration and platform optimization initiatives focused on the Cloudera ecosystem and Apache NiFi. This role is responsible for evaluating, optimizing, modernizing, and operationalizing existing NiFi-based data integration platforms while serving as both a hands-on engineer and a technical advisor.

The ideal candidate will possess strong experience with Apache NiFi, ETL/ELT pipelines, Python automation, Linux environments, and distributed systems.

Employment Type: W2 – Full Time

Location: Cincinnati, Ohio (Hybrid)

Contract Duration :12 Months

Visa Requirement: Permanent Residents Only (Green Card Holders)

Deadline to apply: June 4, 2026

Key Responsibilities

Apache NiFi Platform Engineering

• Assess and optimize existing Apache NiFi and Cloudera environments.

• Review:

  • Processor Configurations

  • Queue Management

  • Flow Prioritization

  • Back Pressure Settings

  • Clustering Strategies

• Improve platform scalability, reliability, and operational efficiency.

• Establish reusable design standards and governance practices.

ETL / ELT Pipeline Development

• Design, develop, optimize, and support enterprise ETL/ELT pipelines.

• Integrate data from:

  • Relational Databases

  • APIs

  • Streaming Platforms

  • Cloud Storage

  • Distributed File Systems

• Support batch and real-time data ingestion.

• Resolve:

  • Pipeline Failures

  • Data Latency Issues

  • Throughput Bottlenecks

  • Operational Instability

Python Automation

• Develop Python-based automation and transformation scripts.

• Build integrations between NiFi and external systems.

• Automate deployment, validation, monitoring, and operational support processes.

• Support custom orchestration and processing logic.

Governance & Security

• Implement enterprise security standards including:

  • Authentication

  • Authorization

  • Encryption

  • RBAC Controls

  • Secure Data Movement

• Support deployment procedures and operational runbooks.

• Assist with version control and CI/CD processes.

Advisory & Collaboration

• Serve as a technical advisor for platform modernization initiatives.

• Document:

  • Architecture Recommendations

  • Operational Procedures

  • Knowledge Transfer Materials

  • Optimization Findings

• Collaborate with:

  • Data Engineers

  • Architects

  • DevOps Teams

  • Infrastructure Teams

  • Analytics Teams

  • Application Teams

Technical Environment

Data Integration & Processing

• Apache NiFi

• ETL / ELT Pipelines

• Data Integration Platforms

Programming

• Python

Infrastructure

• Linux

• Distributed Systems

Big Data & Cloudera

• Kafka

• Hive

• HDFS

• Iceberg

DevOps

• CI/CD Pipelines

Architecture

• Cloud & Hybrid Environments

What Success Looks Like

• Improve performance and reliability of enterprise NiFi environments.

• Optimize large-scale ETL/ELT pipelines.

• Reduce operational overhead through automation.

• Establish reusable platform standards and governance practices.

• Deliver scalable and maintainable data integration solutions.

• Support long-term platform modernization initiatives.