Data Engineer

At Darwin Insurance, we’re shaping the future. With a mission to make insurance easier and better value for our customers, we embrace change in all its richness and variety. It’s not just what we do; it’s how we do it.

We are a brand from Direct Line Group, which also includes Direct Line, Churchill, Privilege & Green Flag . We appreciate the knowledge and skills that each one of us brings to the business. It’s hard not to be inspired by the things that make us unique. Boldness, curiosity, and enthusiasm go a long way, and they’re helping us transform the industry we lead.

As a Data Engineer, you will play a key role in developing and maintaining robust cloud-based solutions fit for low-latency, highly-available, machine learning solutions within AWS.

What you’ll be doing:

• Cross-Functional Collaboration and Stakeholder Communication: Lead collaborations with cross-functional teams to understand business requirements and communicate complex data concepts clearly to non-technical stakeholders, facilitating informed decision-making across the organization.
• Data Solutions Development and Documentation: Design robust data transformation solutions using ETL and ELT methodologies and maintain comprehensive documentation for all data pipelines and integration procedures to ensure clarity and effective management.
• Performance Monitoring and Data Quality Assurance: Proactively monitor data systems for performance optimization and implement data quality checks to maintain high standards of accuracy and reliability in data processing.
• Security and Compliance: Develop and enforce security protocols to protect data assets and ensure all data handling complies with legal and regulatory standards, supporting robust data governance.
• Innovation and Technology Advancement: Stay abreast of advancements in data engineering technologies and practices, incorporating innovative tools and methods to enhance the organization’s data capabilities.
• Mentorship and Team Leadership: Mentor junior data engineers, fostering an environment of growth and continuous learning, while leading by example in technical expertise and basic project management.
• Architectural Collaboration and Optimization: Work closely with data architects and other engineers to refine data storage and architecture, ensuring the infrastructure supports scalable solutions and future technological developments.

What we’re looking for:

• Significant years of experience, gained in professional services setting, in designing and implementing complex data transformations using both ETL and ELT methodologies to support scalable data architecture in high-demand environments.
• Excellent understanding of distributed data processing, ideally working with Apache Spark
• Extensive experience (5+ years) with advanced SQL techniques and database management, including proficiency with database systems like PostgreSQL, MySQL, and Amazon Redshift, optimizing database performance and integrity in large-scale environments.
• In-depth knowledge of AWS cloud services including Glue, S3, KMS, Lambda, and Kinesis, demonstrating capability in deploying and managing scalable, secure cloud infrastructure.
• Advanced proficiency in Python programming, with demonstrated experience in developing, automating, and enhancing data processing tasks and analytical applications.
• Strong command over Unix/Linux operating environments, with the ability to manage and optimize system performance for data applications.
• Solid understanding and practical experience in Agile development processes, skilled in translating strategic goals into executable stories, with a focus on incremental and iterative delivery.
• Strong advocate for Software Craftsmanship and Clean Code, with a commitment to maintaining high standards in code quality and system reliability.
• Demonstrated experience and passion for Test-Driven Development (TDD), ensuring robust and reliable software solutions through comprehensive testing practices.
• Excellent communication skills, capable of effectively articulating technical concepts to both technical and non-technical stakeholders, facilitating clear understanding and cooperative problem-solving.
• Clear understanding of DevOps practices and Infrastructure as Code, with hands-on experience in automating and optimizing infrastructure deployment and management.
• Over 5 years of experience managing clustered systems, ensuring high availability and performance scalability in distributed computing environments.
• Expert knowledge of various database technologies, including SQL and NoSQL, and their appropriate use cases and trade-offs, guiding optimal database selection and use.

What we’ll give you:

We recognise we wouldn't be where we are today without our colleagues, that's why we offer excellent benefits designed to suit your lifestyle:

• 9% employer contributed pension
• 50% off home, motor and pet insurance plus free travel insurance and Green Flag breakdown cover
• Life Assurance
• Income Protection
• Additional optional Health and Dental insurance
• EV car scheme allows all colleagues to lease a brand new electric or plug-in hybrid car in a tax efficient way.
• 25 days holiday rising to 28 with service and the opportunity to buy/sell up to 5 days per year
• Buy as you earn share scheme
• Employee discounts and cashback
• Plus many more

Ways of Working

Our hybrid model way of working offers a 'best of both worlds' approach combining the best parts of home and office-working, offering flexibility for everyone. When you'll be in the office depends on your role, but most colleagues are in 2 days a week, and we'll consider the flexible working options that work best for you. Read our flexible working approach here

There’s no-one else like you. No-one with the exact same mix of strengths, quirks, skills and thoughts. That’s why you could belong here. As part of a team of brilliant individuals, in a place that empowers you to be the best you can be. We’re proud of who we are, of what we do, and what every single one of us brings. Join us. Help us keep innovating and putting customers at the heart of everything. To be an insurance company of the future. When we work together, we can all achieve great things. Inspiring, challenging, and supporting each other to aim higher.

Together we’re one of a kind.

#LI-Hybrid 

#LI-LH1