Senior Data Engineer
Creditsafe View all jobs
- Dublin
- Permanent
- Full-time
- You will actively contribute to the codebase and participate in peer reviews.
- Design and build metadata driven, event based distributed data processing platform using technologies such as Python, Spark, Airflow, Iceberg, DynamoDB, AWS Glue, S3.As an experienced Engineer, you will play a critical role in the design, development, and deployment of our business-critical system.
- You will be building and scaling Creditsafe’s data pipelines combining batch and streaming approaches and targeting sub-100ms latency serving.
- Understanding domain data to make recommendations to improve the existing product.
- Employing various AI tools such as Perplexity, Cursor, CoPilot, etc to aid in all aspects of your work
- You understand and can implement data engineering best practices.
- You demonstrate the ability to write clean & efficient code and combine it with the cloud environment for best performance.
- Proven experience of development experience within a commercial environment creating production grade data pipelines in python.
- We appreciate someone that is looking to grow your skills through daily technical challenges and enjoy problem solving, whiteboarding in collaboration with team.
- You have excellent communication skills, and ability to explain your views clearly to the team and are open to understanding the views of others.
- You have a proven track record to draw from a deep and broad technical expertise to mentor engineers, complete hands-on technical work, and provide leadership on complex technology issues.
- You share your ideas collaboratively via wikis, discussions boards, etc and share any decisions made, for the benefit of others.
- Be able to take ownership of end-to-end deliverables from planning all the way to production.
- Career Progression: Clearly defined career progression path with opportunities to grow as a technical leader or move into adjacent roles.
- Learning & Development: Access to a plethora of learning resources and courses to perpetually enhance your skills, with weekly dedicated training and focus time.
- Work-Life Balance: Committed to promoting a balanced lifestyle with flexible working hours and hybrid work options.
- Innovation: Engage in exciting projects, harnessing the power of the latest technologies in cloud computing and data management.