About the Role:

We are seeking a highly skilled and delivery-focused Senior Engineer with demonstrable expertise in data architecture & engineering and an Agile mindset. The ideal candidate will thrive in dynamic environments, excel at working collaboratively with cross-functional teams, and drive the design, development, and maintenance of scalable data solutions. Your role will be pivotal in ensuring the reliability and efficiency of our data pipelines, processing frameworks, and cloud-native infrastructure.

You will bring advanced skills in stream processing frameworks, Big Data technologies, Elasticsearch, Kafka along with a strong understanding of Kubernetes and container orchestration. If you are passionate about building high-quality systems and enabling data-driven decision-making, we’d love to hear from you.

Your responsibilities:

• Design, implement, and maintain real-time data streaming pipelines using Kafka and other stream processing frameworks (e.g., Apache Flink, Spark).
• Develop and optimize ETL/ELT workflows for high-volume, low-latency data processing.
• Index data into Elasticsearch at scale.
• Architect scalable data systems using modern big data technologies (e.g., Delta, Databricks, Hadoop, Apache Spark, Beam, Nifi).
• Provide access to data using microservice patterns & domain driven design to extend our Api estate.
• Deploy, monitor, and manage data infrastructure in Kubernetes and cloud-native environments (AWS).
• Ensure data quality, integrity, and consistency through automated testing and monitoring.
• Advocate for Agile methodologies, encouraging iterative development, continuous integration, and incremental delivery.
• Implement best practices for security, data governance, data tiering, storage and performance.
• Raise the bar for the data engineering team by driving best practices, code quality, cost and performance optimization.
• Troubleshoot and resolve technical challenges related to data pipelines and infrastructure.
• Stay updated on emerging technologies and bring innovative solutions to the team.
• Collaborate with product managers and other stakeholders to define and deliver high-quality data solutions aligned with business needs.

Who you are:

• Excellent command of English language both written and spoken
• Advanced proficiency in Kafka (producers, consumers, connectors, and schema registry) and processing frameworks such as Apache Flink, Spark, Nifi.
• Proficiency in Python, showcasing your understanding of Object-Oriented Programming (OOP) principles.
• Strong understanding of technologies such as Databricks, Delta Lake, Hive, etc.).
• Solid experience with Elasticsearch.
• Proficiency with containerization and orchestration tools, especially Kubernetes.
• Familiarity with Git/Github, modern CI/CD pipelines and tools for deploying distributed data systems (github actions, fluxcd).
• Experience with AWS and managed services including Lambda, Kinesis, Athena, MSK.
• Solid understanding of relational databases (PostgreSQL, MySQL) and NoSQL databases.
• Strong grasp of Agile principles and practices.
• Good understanding of release management, embracing rigorous testing, validation, and quality assurance protocols.

What we can offer:

We are a global fast growing company which offers a variety of opportunities for you to develop your skill set and career. In exchange for your contribution, we can offer you:

Competitive salary and benefits

Hybrid working in a team that is passionate about the work we deliver and supporting the development of those that we work with

A company focus on wellbeing and work life balance including initiative’s such as flexible working and mental health support

We want the best talent available, regardless of race, religion, gender, gender reassignment, sexual orientation, marital status, pregnancy, disability or age.