Big Data Engineer

Inetum is seeking a seasoned Big Data Engineer to join our team and support the operations of our Hadoop-based data lake environments. This is a critical role for ensuring the performance, reliability, and security of our big data infrastructure.

Key Responsibilities

• Operate, monitor, and support Hadoop-based data lake platforms.
• Provide L3 incident response, deep troubleshooting, and performance tuning for big data components.
• Ensure data integrity, replication, and capacity management within HDFS clusters.
• Develop and automate monitoring and alerting for service health and node performance.
• Collaborate with platform and data teams to onboard new workloads with optimal resource allocation.
• Apply patches, upgrades, and configuration changes to maintain platform security and stability.
• Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption.
• Work with storage, network, and security teams to optimize throughput and access controls.
• Maintain cluster documentation and share knowledge across teams.

 

• Bachelor’s degree in Computer Science or equivalent.
• Minimum 5 years of experience in a similar role.
• Strong expertise in:
  • Hadoop Ecosystem & Data Lake Operations
  • Big Data Services & Query Engines
  • Security & Access Control in Distributed Environments
  • Monitoring, Automation & Platform Lifecycle Management
• Proven ability to diagnose and resolve complex issues in Big Data environments.
• Strong communication skills to collaborate with cross-functional teams.
• English proficiency: B2-C1 level

Nice to Have:

• Big Data certifications (e.g., Cloudera).
• Familiarity with Kafka, NiFi, or Flume for ingestion pipelines.
• Knowledge of ITIL processes for incident and change management.