Senior Software Engineer (Big Data)

Overview What You’ll Achieve: Design, develop, and maintain scalable data processing solutions across on-premises and cloud environments using Python and Apache Spark

Optimize and fine-tune Spark jobs for performance, including resource utilization, shuffling, partitioning, and caching, to ensure maximum efficiency in large-scale big data environments

Design and implement scalable, fault-tolerant data pipelines with end-to-end monitoring, alerting, and logging

Leverage AWS cloud services (2+ years preferred) to build and manage data pipelines and distributed processing workloads

Develop and optimize SQL queries across relational and data warehouse systems (RDBMS/Data Warehouse)

Apply design patterns and best practices for efficient data modeling, partitioning, and distributed system performance

Use Git (or equivalent) for source control and maintain strong unit and integration testing practices

Collaborate with Product Owners, partners, and multi-functional teams to translate business requirements into technical solutions

Demonstrate strong analytical skills with the ability to extract actionable insights from large datasets and support data-driven decision-making

Mentor junior engineers, conduct code reviews, and contribute to establishing engineering best practices and standards

Who You Are: 5+ years of software development experience in a scalable, distributed, or multi-node environment

Proficient in programming with Scala, Python, or Java; comfortable building data-driven solutions at scale

Significant experience with Apache Spark and exposure to Hadoop, Hive, and related big data technologies

Demonstrated experience with cloud platforms (AWS, preferred) and an interest in cloud migration projects

Eager to deepen your expertise with the Databricks platform

Exposure to modern data tools and frameworks such as Kubernetes, Docker, and Airflow

Strong problem-solving skills with the ability to own problems end-to-end and deliver results

Consultative mentality — comfortable taking initiative, building relationships, communicating broadly, and tackling challenges head-on

Collaborative teammate with an eagerness to learn from peers and mentors while contributing to a culture of growth

Motivated to grow your career within a dynamic, innovative company

What you’ll bring: BA/BS in Computer Science or related field

At least 5 years of experience as a big data software developer

Experience in Machine Learning, including model development, feature engineering, or integrating ML workflows into data pipelines

Experience with Databricks, including Notebooks, Delta Lake, Jobs, Pipelines, and Unity Catalog, preferred

Proficiency with the ELK stack (Elasticsearch, Logstash, Kibana) for real-time search, log analysis, and visualization, preferred

AWS, Databricks, or Spark certification a plus

Click here to view how Epsilon transforms marketing with 1 View, 1 Vision, 1 Voice

Additional Information When You Join Us, We’ll Create Something EPIC Together Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem

For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual

And 1 Voice to harmonize engagement across paid, owned and earned channels

Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology

We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements

Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC

Epsilon is a global company with more than 9,000 employees around the world

Our pillars aren't just words

They're how we show up every day

People centricity: We focus on employee well-being in an environment where colleagues truly care about each other

Collaboration: We work together, support one another, and collectively achieve goals

Growth: There are endless opportunities for growth through learning, development and career advancement

Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches

Flexibility: We’ve created a balance between work and personal life, and we encourage adaptability to solve problems creatively

Our values guide us to create value for our clients, our people and consumers

Act with integrity Work together to win together Innovate with purpose Respect all voices Empower with accountability These pillars and values are our foundation—shaping our culture, guiding our decisions, and uniting us in common purpose

Because You Matter As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first

Our benefits encompass a wide range of offerings, including but not limited to the following: Time to Recharge: Flexible time off (FTO), 15 paid holidays Time to Recover: Paid sick time Family Well-Being: Parental/new child leave, childcare & elder care assistance, adoption assistance Extra Perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling Epsilon benefits are subject to eligibility requirements and other terms

Epsilon is an Equal Opportunity Employer

Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law

Epsilon also prohibits harassment of applicants and employees based on any of these protected categories

Epsilon will provide accommodations to applicants needing accommodations to complete the application process

Please reach out to [email protected] to request an accommodation

For San Francisco Bay and Los Angeles Areas: Epsilon will consider for employment qualified applicants with criminal histories in a manner consistent with the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance

Applicants with criminal histories are welcome to apply. #LI-AM1 Compensation Range: USD $88,900.00 - USD $165,100.00/NA

This is the pay range the Company believes it will pay for this position at the time of this posting

Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time

Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met

Temporary roles may also qualify for participation in our 401(k) plan after eligibility criteria have been met

For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off

The Company anticipates the application deadline for this job posting will be 11/25/2025.