Lead Data Engineer
Mastercard
- Dublin Whelan, SK
- Permanent
- Full-time
As a Data Engineering Manager, you will lead a team of data engineers and data analysts in implementing advanced GDPR compliant, cloud-native Big Data Analytics and advanced AI applications. The cornerstones of our delivery process are predictability and quality. You must be very passionate about these two aspects in the context of Big Data Engineering and take ownership in supporting the team to achieve these as a part of our overall Engineering culture. A great candidate will be a true mentor to the team and have a real passion for developing robust solutions to complex data engineering problems. This role is a blend of 70% hands-on technical work (such as coding, execution of PoCs, architecting solutions, selection of 3PP libraries, code reviews), and 30% stakeholder management.This position reports to Trūata’s Head of Data Engineering.Key Responsibilities:
− Support the team throughout the entire data engineering development lifecycle: Requirements gathering, design and development, testing, bug fixing, cloud deployment, and productization.
− As a people leader, you will drive engagement and will be accountable for demonstrating and role modelling the team’s values and behaviors through skillful mentoring and by delivering against business objectives.
− Continuously monitor and improve operational aspects, such as cost, performance, and maintainability of our growing codebase.
− Implement appropriate metrics and apply a data-driven approach to understanding overall project health, identification of bottlenecks, or process improvement opportunities.
− Drive the team’s capability and performance through strong technical leadership, coaching, mentoring, performance feedback, and career development.
− Build a trusting and safe environment where team members are comfortable to raise concerns, problems, etc. and work towards a resolution.
− Partnering with external and internal project stakeholders on an on-going basis, providing project status updates, timely resolution of escalations, and participation in forward-looking planning sessions.Qualifications:
− University degree in a STEM field. Advanced degree preferred.
− Minimum of 8 years of experience in a hands-on Lead Data Engineering role, working as a sole contributor on all aspects of a project: Design, implementation, testing, delivery.
− Deep technical knowledge of modern, distributed computing frameworks and platforms, especially Apache Spark, Databricks, SQL, and one or more programming languages, such as Python or Scala.
− Advanced working knowledge in implementing analytical applications and data pipelines on top of cloud technology stacks (e.g., Azure, AWS, GCP).
− Experience with Spark application performance analysis & tuning, particularly on Databricks, is a plus.
− Strong focus on delivering cost-efficient, scalable, re-usable solutions.
− Creativity and a passion for tackling demanding engineering challenges and willingness to work in a fast-paced environment backed by a larger organization.
− Excellent presentation, documentation, communication and influencing skills.
− An ability to keep track of multiple concurrent projects and work streams of varying sizes and stages of completion.
− Strong verbal and written communication skills with a talent to capture complex technical matters in a concise manner.
− Exceptional discipline and organizational skills.
− Mastery of Jira and Confluence is a big plus.
− Working knowledge of implementing CI / CD pipelines.Corporate Security ResponsibilityAll activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:Abide by Mastercard’s security policies and practices;Ensure the confidentiality and integrity of the information being accessed;Report any suspected information security violation or breach, andComplete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.