
Senior Data Engineer
- Dublin
- Permanent
- Full-time
- Design, develop, and maintain scalable data pipelines using AWS services, Databricks, and graph databases.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Implement data integration and transformation processes to ensure data quality and consistency.
- Optimise and manage data storage solutions, ensuring efficient data retrieval and processing.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Stay up-to-date with the latest industry trends and technologies in data engineering and make recommendations for improvements.
- Document data engineering processes, workflows, and best practices.
- Formal training or certificate in Computer Science, Information technology and proficient advanced experience.
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in AWS services such as S3, Lambda, Glue, and Redshift.
- Experience with Databricks for data processing and analytics.
- Familiarity with thatDot Streaming Graph for real-time data processing.
- Proficiency in programming languages such as Python for scripting and automation.
- Strong SQL skills for querying and managing relational databases.
- Experience with Cypher for querying graph databases.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Experience with data modelling and ETL processes.
- Knowledge of big data technologies such as Apache Spark and Kafka.
- Familiarity with data visualization tools and technique