Data Engineering Lead

5 days ago

London, Greater London, United Kingdom Coatue Management L.L.C. Full time

About the Opportunity:

We are seeking a Data Engineering Lead to join our team at Coatue Management L.L.C. in London.

Responsibilities:

  1. Design and extend highly performant, scalable, secure, and cost-effective cloud-based big data solutions.
  2. Lead the design and implementation of production-level workloads, including end-to-end pipeline load performance testing and optimisation.
  3. Collaborate with Solution Architects to provide technical expertise and guidance on complex technical sales.
  4. Develop and maintain deep knowledge of development tools and best practices for engineers, including CI/CD, unit and integration testing, plus automation and orchestration.
  5. Mentor and lead junior team members to develop their skills and knowledge.
  6. Report to the Manager, Field Engineering (Specialist).
  7. The impact you will have:
    1. Provide technical leadership to guide strategic customers to successful implementations on big data projects, ranging from architectural and security design to development and deployment best practices including automation.
    2. Architect production-level workloads, including end-to-end pipeline load performance testing and optimisation.
    3. Assist Solution Architects with more advanced aspects of the technical sale including custom proof of concept content, workload sizing, and custom architectures.
    4. Improve community adoption (through tutorials, training, hackathons, conference presentations).
    5. Contribute to the Databricks Community and act as a technical SME.
    6. Experience designing cloud infrastructure and services, such as AWS, Azure, or GCP using best practices in cloud security and networking, including several of the following:
      1. Designing, deploying, and maintaining cloud networks.
      2. Infrastructure security (e.g. managing network-level security, private endpoints, firewalls, etc).
    7. Cybersecurity with threat monitoring, protecting, and testing experience.
    8. Familiarity with big data technologies such as Spark/Delta, Hadoop, and MPP.
    9. Deep knowledge of development tools and best practices for engineers including CI/CD, unit and integration testing, plus automation and orchestration.
    10. Production programming experience in one or more of the following languages - Python, Scala, SQL, or R.
    11. Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent work experience.
    12. The role is located in London and requests travel up to 30% when needed.

Salary: £90,000 - £120,000 per annum.

  • Data Engineering Team Lead

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £90,000 - £110,000

    Job DescriptionWe are currently looking for a Lead Data Engineer to join our team. As a key member of our data engineering function, you will be responsible for designing, building, and maintaining robust ETL processes and data infrastructure. You will also write custom code to enhance data extraction, transformation, and loading processes.

  • Enterprise Data Engineer Lead

    5 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Science Festival is a dynamic and innovative organisation, always pushing the boundaries of what is possible with data. We are seeking an experienced Enterprise Data Engineer Lead to join our team and lead the development of our data infrastructure.About the RoleThis is an exceptional opportunity to work on a wide range of projects, from designing data...

  • Cloud Data Engineering Lead

    5 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    About the OpportunityAt the Data Science Festival, we are committed to driving innovation and excellence in data engineering. We are seeking a Cloud Data Engineering Lead to join our team and play a key role in shaping our data strategy.Key ResponsibilitiesDevelop and implement data pipeline architectures using modern cloud technologiesLead cross-functional...

  • Data Engineering Manager Lead

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager£90,000 - £99,000 per annum is the estimated salary for this role.This position is based in London – hybrid and requires a team player who can support the delivery of data transformation.We are working with one of the best-known retail brands in the UK. As a Data Engineering Manager, you will collaborate with teams to implement...

  • Lead Data Engineer in Retail Excellence

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    About Data IdolsWe're a leading retail brand in the UK, and we're seeking an exceptional Staff Data Engineer to drive our data transformation journey. This is a unique opportunity for someone with experience in data pipelines to contribute to our success.The RoleIn this critical position, you will support the delivery of data transformation, collaborating...

  • Data Engineering Lead

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    In this exciting role as a Staff Data Engineer at Data Science Festival, you will have the opportunity to design, develop, and deploy cutting-edge data solutions using Azure, Spark, and Python. Our team is dedicated to delivering high-quality data products that drive business value, and we're looking for someone to join us in this mission.Your Key...

  • Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    About the RoleAs a Staff Data Engineer, you'll be responsible for building and maintaining complex data pipelines, collaborating with our wider data teams to deliver insights that drive business growth.The ideal candidate will have extensive experience with data pipelines, data warehousing, and cloud-based technologies such as Azure.

  • Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    About the RoleWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. This is an exciting opportunity for someone with extensive experience in building and maintaining data pipelines, as well as collaborating with wider data teams.

  • Cloud Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    About the RoleWe are currently seeking a Senior Data Platform Engineer to join our team at Data Idols, a renowned retailer in the digital-first era. This is an exciting opportunity to contribute to the design, implementation, and maintenance of a robust data platform essential to our ongoing digital transformation.Your Key Responsibilities:Design and...

  • Big Data Engineering Lead

    1 month ago

    London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...

  • Cloud Data Architect Lead

    5 days ago

    London, Greater London, United Kingdom Data Intellect Full time

    Lead Data Engineer & ArchitectWe are looking for a highly skilled Cloud Data Architect Lead to lead our Databricks practice and drive innovation in data-driven solutions. This role requires experience in designing and deploying large-scale data pipelines, ETL processes, and data lakes using Databricks.The successful candidate will have a solid understanding...

  • Data Engineering Manager

    5 days ago

    London, Greater London, United Kingdom Data Intellect Full time

    About the RoleWe are seeking an experienced Data Engineering Manager to lead our Databricks practice and drive innovation in data-driven solutions. This is a unique opportunity for someone who wants to shape the future of data engineering within a fast-growing, forward-thinking company.The ideal candidate has a deep understanding of cloud-based data...

  • Cloud Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    About the RoleAs a Staff Data Engineer at the Data Science Festival, you will play a key role in driving high standards across the data function. You will design, develop, and maintain data pipelines using Python and Azure, and collaborate with the wider data teams to achieve business objectives. The ideal candidate will have extensive experience with data...

  • Enterprise Data Engineering Lead

    1 month ago

    London, Greater London, United Kingdom Data Science Festival Full time

    About Our ClientOur client is a renowned software company dedicated to providing innovative data solutions to the public sector. With a strong focus on collaboration and customer satisfaction, they strive to make a positive impact on society.They are now seeking a talented Full-stack Data Engineer to join their team for an initial three-month contract. This...

  • Data Engineering Expert

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £100,000

    Company OverviewData Idols is a leading UK-based brand seeking an experienced Senior Data Engineer to support the delivery of data transformation during an exciting time within the company. With a strong focus on building and maintaining data pipelines using modern data technologies in a cloud environment, this role requires extensive experience with data...

  • Data Engineer

    5 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    We are currently seeking a Senior Data Platform Engineer to join our prestigious retailer that's evolving into a digital-first, data-led organisation. In this role, you'll be pivotal to shaping the data landscape and will work alongside a talented, collaborative team to build, optimise, and secure scalable data infrastructure.Estimated Salary: 80,000 –...

  • Data Engineer for Data Transformation

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    About UsData Idols is a renowned retail brand in the UK, and we're looking for a highly skilled Staff Data Engineer to join our team. With an exciting project on the horizon, this role offers the perfect opportunity for someone with experience in building and maintaining data pipelines to make a real impact.The OpportunityAs a Staff Data Engineer, you will...

  • Data Product Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Product LeadLocation: 1-2 days a week in London officeWe are seeking an experienced Data Product Lead to develop and maintain the roadmap for products, collaborating with the Data Science and Data Engineering team.This role requires fulfilling agile product management responsibilities for data products, ensuring seamless collaboration with stakeholders...

  • Data Engineer Team Lead

    1 month ago

    London, Greater London, United Kingdom Data Science Festival Full time

    We are looking for a highly skilled Senior Data Engineer to join our team at the Data Science Festival. This role involves supporting the delivery of data transformation and collaborating with the wider data teams.Job DescriptionThe ideal candidate will have extensive experience with data pipelines, data warehousing, and driving high standards across the...

  • Data Management Lead

    5 days ago

    London, Greater London, United Kingdom Data Bene Full time

    Job Title: Data Management LeadJob Description:As a seasoned professional in data centre construction, we are seeking an experienced Data Management Lead to oversee the delivery of large-scale projects. This role requires strong strategic thinking skills, excellent communication abilities, and a thorough understanding of the total project life cycle.About...