
Big Data Engineer (Financial Services) Consultant/Senior Consultant, Technology Consulting
Job Description
Ability to clearly explain data and analytics strengths and weaknesses to both technical and senior business stakeholders
Develop and maintain strong effective working relationships with key management personnel and internal client base including data engineers, BA’s and directly with the services/businesses
Responsible for developing batch ingestion and data transformation routines using ETL tools or other ingestion techniques
Responsible for developing real-time ingestion and data transformation routines using Kafka and similar technologies
Responsible for migrating data from legacy data platform to cloud data platform
Present data in graphs, charts, tables, etc. and designing and developing relational databases for collecting data.
Keep track of trends, patterns, and correlation in case of complex data sets.
Be involved in all aspects of the project life-cycle, including strategy, road-mapping, architecture and implementation to gain maximum exposure to set you up for a successful consulting career.
Configuration and coordination of data pipelines across projects
Data pipeline development, including Azure Data Factory, AWS Kinesis, Spark
Migration and transformation of large complex data sets from legacy systems like Teradata to cloud platform using Azure tools and other ETL tools like DataStage (ideally 5+ Years)
Data and Reporting Platform development on environments using technologies such as Microsoft Azure, SAP BW, Teradata, PowerBI or Cognos