Senior Data Platform Engineer

Dublin
Permanent
Full-time

2 months ago

Apple Services Engineering (ASE) is the organisation responsible for products such as Apple Music, Podcasts, TV+, tvOS, App Store, iCloud, and many others. We, at ASE Analytics and Data Engineering, are responsible for collecting, analysing and reporting on insights derived from user and device generated data from across all Apple media services. Reporting plays a crucial role in this process, enabling teams at Apple to gain valuable insights and make informed decisions about their daily activities. Reporting involves integrating data from multiple data pipelines managed by different teams, which presents challenges such as achieving clear visibility into the dependencies and SLAs of the contributing flows. To address these challenges, we are establishing a new team in Dublin to develop internal tools that will enhance our ability to manage these complexities.DescriptionWe are looking for a Senior Data Platform Engineer to build out services and ingestion related to a knowledge graph. This knowledge graph aims to unify insights on data processing-job telemetry, SLA expectation and attainment, data quality, infra incidents-using job lineage to build a comprehensive and predictive view of data processing 'health' across all of Apple Services data engineering. You'll apply your expertise in data systems to design, build, and support ingestion services to feed and manage data in the knowledge graph (a graph db), and be a part of coming up with new ways to classify and represent data via agentic workflows, to increase the insight available from the graph. We believe graph-based insights can be used to power operational excellence, by capture production issues, driving analysis, guiding resolution of issues and enabling proactive avoidance of future incidents. You'll work alongside a Dublin based team of data and other software engineers committed to bringing the knowledge graph to life. You will have a tremendous amount of individual responsibility and influence over the direction of this critical service for years to come. Additionally, you will have the chance to interact with various other teams, each with unique skill sets and operating in different time zones.Minimum Qualifications

Experience designing and developing data services and/or data platforms
Experience with containerisation and orchestration (e.g., Kubernetes and Apache Airflow )
Experienced in SQL, relational databases, NoSQL databases and ORM tooling
Experience with Apache Spark and Kafka

Preferred Qualifications

Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or equivalent professional experience.
Experience with a graph database (eg ArrangoDB, Neo4j, TigerGraph) and/or graph ontology
Experience with Python and/or Scala
A learning attitude to continuously improve the self, team, and the organisation

Apple

Apply Now