Lead Data Engineer
1 month ago
Key Responsibilities
- Lead the design, architecture, and implementation of the studio’s data stack, ensuring scalability, efficiency, and alignment with both technical and business goals.
- Collaborate with analytics and game development teams to create broader insights and build data systems that provide valuable, actionable information.
- Participate in all stages of agile software development and lifecycle management, including design, implementation, testing, deployment, and maintenance.
- Develop near real-time and batch-based data processing frameworks to support live game operations, player behavior analysis, and other key business insights.
- Build and maintain large-scale data pipelines, ensuring high performance and low latency across diverse data sets.
- Design and implement continuous integration and continuous delivery (CI/CD) pipelines to automate deployment and streamline processes.
- Develop tools and software that enhance our ability to capture, process, and analyze data at scale, improving decision-making for all teams.
- Oversee the integration of data security, ensuring compliance with GDPR, PII policies, and best practices in data governance.
- Provide technical leadership on data engineering projects, setting standards, guiding architecture decisions, and ensuring delivery aligns with the studio's strategic goals.
- Mentor and lead on data engineering in the studio, fostering a collaborative environment of innovation, technical excellence, and continuous learning.
- Stay ahead of industry trends in data engineering and apply cutting-edge practices and technologies to maintain our data infrastructure’s competitiveness and efficiency.
Requirements
- Extensive experience in data engineering, with demonstrated leadership in designing and managing data architectures at scale.
- Product-focused mindset with a passion for understanding the games we create and how data can enhance both player experience and business performance.
- Demonstrated expertise in data architecture patterns, including experience building CI/CD data stacks and optimizing data infrastructure for scale and performance.
- Deep knowledge of cloud platforms (AWS, GCP, or Azure) and experience deploying large-scale data systems in a cloud environment.
- Significant experience with cloud-based big data ecosystems such as Snowflake and familiarity with modern data infrastructure tools like DBT, Airflow, and Kafka.
- Proficiency in SQL & Python required; experience with Java or Scala is a plus.
- Hands-on experience with containerization technologies (e.g., Docker, Kubernetes) and orchestration systems for deploying and maintaining applications.
- Strong experience with Linux/Unix systems, including scripting (bash) and managing production environments.
- Proven expertise in ETL/ELT pipeline development and working with large, diverse data sets at scale.
- Strong experience with agile methodologies, turning user stories into actionable engineering tasks, and driving impactful development through collaboration with product owners.
- Knowledge of data governance, security protocols, and best practices related to GDPR, PII, and other data privacy regulations.
- Ability to build strong relationships across teams, empowering engineers and stakeholders through clear communication and collaboration.
- Previous experience leading data engineering efforts within the gaming industry or other fast-paced, data-driven environments.
- Experience in data visualization tools (e.g., Tableau, Looker, Power BI) and the ability to interpret and present complex data insights in a user-friendly way.
- Experience working on projects that involve real-time telemetry, player behavior analytics, or other high-volume, real-time data applications.
- Demonstrated success in leading or contributing to the consolidation of data systems.
BenefitsOur Global Benefits & Perks
- Unlimited coaching & therapy — with Oliva, to support your mental health
- Stock Options — everyone owns a piece of our success
- Pension scheme — up to 5% employer matched contribution to finance those golden years
- Socials — office & remote events, play sessions and company-wide parties
- And even more benefits based on your location
If you’re based in the UK
- 25 Annual Leave + 3 bank holidays - we’re flexible with most bank holidays so you can use the time to celebrate what’s important to you
- Private Medical Insurance - full cover with AXA
- Healthcare Cash Plan - Level 3 cover with Medicash
- Cycle2Work Scheme - lease a bike through us and save on tax too
- Electric Car Charging - electric car charging at our Port office in Edinburgh, Scotland.
-
Data Engineering Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeData Engineering LeadCathcart Technology is seeking an experienced Data Engineering Lead to join their team in Edinburgh. As a Data Engineering Lead, you will be responsible for managing a team of Data Engineers and overseeing the development of world-class products and services.The company is a globally known software business with a strong focus on...
-
Data Engineering Team Lead
3 weeks ago
Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000Lead the Way in Data EngineeringBe-IT is seeking an experienced Data Engineering Manager to lead its Data Engineering team in driving impactful projects that optimize advertising and marketing strategies. As a key member of the company's leadership team, you will leverage your technical expertise to enable data-driven decision making and strengthen...
-
Data Engineering Team Lead
1 week ago
Edinburgh, Edinburgh, United Kingdom Best Buy Health Full timeAbout the Role:We are seeking a highly experienced and skilled Senior Manager – Analytics Engineering to lead our data & analytics engineering team. As part of a broader data organization, you will work collaboratively with cross-functional teams to enable innovative data solutions that improve quality and efficiency of care delivery in hospital-level care...
-
Data Engineering Team Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeThe company Cathcart Technology is seeking a Data Engineering Manager to lead their predominantly Agile team of Data Engineers. The team is responsible for developing world-class products and services in a globally innovative environment.About the RoleAs a Data Engineering Manager at Cathcart Technology, you will be responsible for managing a small team of 6...
-
Data Architect Lead
1 week ago
Edinburgh, Edinburgh, United Kingdom Build a Rocket Boy Full timeJob Description**Build a Rocket Boy** is seeking a highly skilled Data Architect Lead to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing large-scale data systems that drive business insights and inform our game development processes.About the RoleWe are offering a competitive salary of...
-
Data Science Lead
1 week ago
Edinburgh, Edinburgh, United Kingdom Bright Purple Full timeJob DescriptionSenior Data Engineer OpportunityBright Purple is working with a leading tech company in Edinburgh to hire a new Senior Data Engineer as a hands-on lead overseeing the design and development of internal platforms and data solutions. The role requires expertise in designing and developing internal platforms and data solutions. The ideal...
-
Senior Data Engineer
3 weeks ago
Edinburgh, Edinburgh, United Kingdom Bright Purple Full timeBright Purple is currently seeking a Senior Data Engineer to lead the design and development of internal platforms and data solutions for a leading tech company in Edinburgh.As a Senior Data Engineer, you will oversee the development of cloud-hosted data pipelines and work with a passion-driven team to implement innovative solutions.Key responsibilities...
-
Data Engineering Team Lead
19 hours ago
Edinburgh, Edinburgh, United Kingdom Bright Purple Full timeWe're looking for an experienced Senior Data Engineer to lead our data engineering team in Edinburgh. As a key member of our team, you'll play a crucial role in designing and developing internal platforms and data solutions that drive business growth. If you have a passion for data engineering and leadership, this could be the perfect opportunity for you!Our...
-
Data Insights Specialist
1 week ago
Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full timeAbout Smart Data FoundryAt Smart Data Foundry, our mission is to empower financial innovation by unlocking the full potential of data.We achieve this by providing research-ready real financial data, enabling the research ecosystem to flourish.Data-Driven InsightsOur team creates actionable insights based on real financial data, identifying areas for policy...
-
Lead Engineer
4 weeks ago
Edinburgh, United Kingdom Develop Full timeLead Engineer - Data (Mongo Kafka) - £75K + Benefits - HybridThis is a new opportunity with TSB, who are looking to hire a brilliant Lead Engineer specialising in MongoDB and Kafka.You'll play a pivotal role in the design, development, and implementation of mission-critical applications and systems. They leverage their extensive technical expertise and...
-
Lead Engineer
4 weeks ago
Edinburgh, United Kingdom Develop Full timeLead Engineer - Data (Mongo Kafka) - £75K + Benefits - HybridThis is a new opportunity with TSB, who are looking to hire a brilliant Lead Engineer specialising in MongoDB and Kafka.You'll play a pivotal role in the design, development, and implementation of mission-critical applications and systems. They leverage their extensive technical expertise and...
-
Lead Engineer
2 months ago
Edinburgh, United Kingdom Develop Full timeLead Engineer - Data (Mongo Kafka) - £75K + Benefits - HybridThis is a new opportunity with TSB, who are looking to hire a brilliant Lead Engineer specialising in MongoDB and Kafka.You'll play a pivotal role in the design, development, and implementation of mission-critical applications and systems. They leverage their extensive technical expertise and...
-
Lead Engineer
2 months ago
Edinburgh, United Kingdom Develop Full timeLead Engineer - Data (Mongo Kafka) - £75K + Benefits - HybridThis is a new opportunity with TSB, who are looking to hire a brilliant Lead Engineer specialising in MongoDB and Kafka.You'll play a pivotal role in the design, development, and implementation of mission-critical applications and systems. They leverage their extensive technical expertise and...
-
Lead Engineer
4 weeks ago
Edinburgh, United Kingdom Develop Full time €75,000Lead Engineer - Data (Mongo Kafka) - £75K + Benefits - Hybrid This is a new opportunity with TSB, who are looking to hire a brilliant Lead Engineer specialising in MongoDB and Kafka. You'll play a pivotal role in the design, development, and implementation of mission-critical applications and systems. They leverage their extensive technical expertise...
-
Edinburgh, Edinburgh, United Kingdom Change Digital – Digital & Tech Recruitment Full timeWe are seeking a highly skilled Data Engineering Manager to lead our team of up to 12 professionals.The successful candidate will be responsible for overseeing the design and development of scalable systems using cloud technology.A key aspect of this role will be managing high-level design and code reviews, ensuring that our data engineering solutions meet...
-
Senior Data Architecture Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Royal London Group Full timeAbout the RoleJob Title: Senior Data Architecture LeadLocation: UK-wideWorking style: Hybrid 50% home/office basedContract Type: PermanentAt Royal London Group, we're seeking a Senior Data Architecture Lead to spearhead the development of our Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our...
-
Data Engineering Manager
1 month ago
Edinburgh, Edinburgh, United Kingdom Cathcart Associates Group Ltd Full timeData Engineering ManagerCathcart Associates Group Ltd is seeking a highly skilled Data Engineering Manager to lead their team of Data Engineers. The ideal candidate will have a strong background in Data Engineering and experience in managing small and Agile teams.Key Responsibilities:Manage a team of 6-12 Data EngineersLead the development of the team and...
-
Data Engineering Director
3 weeks ago
Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000Be-IT is looking for a Data Engineering Director to lead its Data Engineering team. This is a great opportunity to drive impactful projects with a clear impact on customer experience and company revenue.As Data Engineering Director, you will lead a talented group of data engineers, leveraging a variety of technologies to support the company's advertising...
-
Data Analytics Lead Developer
4 weeks ago
Edinburgh, Edinburgh, United Kingdom BBC Full timeAbout the RoleThe BBC is seeking a skilled Data Analytics Lead Developer to join its Product Data Domain team. The successful candidate will be responsible for designing, implementing, and maintaining dimensional data models that promote a self-service approach to data consumption.Main ResponsibilitiesLeading on the design, implementation, and maintenance of...
-
Data Engineer
6 months ago
Edinburgh, United Kingdom Hymans Robertson Full timeThe Vacancy This is your opportunity to play a key role within our Insights & Analytics practice; focused on the delivery of platforms and processes that enable the effective use of data by the wider consulting business. Our firm invests in the very latest technologies to facilitate the delivery of our ground-breaking business solutions. Our team...