Back to jobs
Job Description
Purpose:
The goal of the DevOps Engineer Big Data is to build and maintain reliable and scalable systems for Big Data processing. Develop scripts and tools to automate deployment tasks and monitor critical aspects of the operation, resolve engineering problems and incidents. Collaborate with developers to help create platforms for the future. Work closely with Big Data and Software engineers to understand our applications and keep them running smoothly.
Responsibilities:
Infrastructure planning and maintenance in the Big Data and Software environments
Mentors, supports, and coaches colleagues, Data Scientists, Data Engineers and Software Engineers, regarding infrastructure topics
Find ways to automate tasks, monitor and to continuously improve our systems
Documents the work for the developed solutions and maintain consistency of information
Make the infrastructure resilient and efficient
Qualifications & Requirements:
A bachelor's degree in computer science, Engineering or related education or experience
Experience working as DevOps Engineer, Site Reliability Engineer or Systems Engineer
Proficiency working with Linux systems and scripting languages (Bash, Python)
Experience with Docker and Kubernetes environments (OKD, Openshift, Rancher)
Experience working with distributed systems and high availability technologies
Experience working with Ceph or other distributed storage systems will be valued
Experience working with on-premise infrastructure or hybrid environments will be valued
Experience working in cloud environments (AWS or Azure) will be valued but not required
Experience working on infrastructure for Big Data will be valued
Skillset
Proven ability to design, build, and maintain scalable infrastructure for Big Data and Software environments
Skilled in leveraging monitoring systems for getting insights on reliability and performance
Decisive in solving infrastructure incidents and diagnosing technical problems
Strong collaboration skills to work with architects, developers, and cross-functional teams
Capable of documenting solutions, communicating ideas and knowledge
Ability for learning and adapting to technology changes
Committed to building resilient and efficient infrastructure
