Senior Data Engineer with ETL Expertise

4 weeks ago


London, Greater London, United Kingdom N Consulting Ltd Full time
Job Title: Senior Data Engineer with ETL Expertise

N Consulting Ltd is seeking a highly skilled Data Engineer to join our team in London. The ideal candidate will have experience working with ETL processes and possess strong technical skills.

Estimated Salary:£80,000 - £110,000 per annum, depending on experience.

About the Role

This is an exciting opportunity for a senior data engineer to lead the development and implementation of ETL processes using Python. The successful candidate will work closely with cross-functional teams to design, develop, and deploy scalable data pipelines.

The role requires proficiency in Python scripting, SQL programming, and experience working with cloud-based technologies such as Azure Databricks and AWS(S3). A strong understanding of DevOps principles and CI/CD practices is also essential.

Key Responsibilities
  • Design, develop, and maintain ETL processes using Python.
  • Collaborate with cross-functional teams to identify business requirements and design scalable data pipelines.
  • Implement and optimize data processing workflows using Azure Databricks and AWS(S3).
  • Develop and maintain automated testing frameworks to ensure data quality and integrity.
  • Maintain accurate documentation of ETL processes and data pipelines.
Requirements
  • 6+ years of experience in data engineering with a focus on ETL processes.
  • Proficiency in Python scripting, SQL programming, and cloud-based technologies.
  • Experience working with Agile and Scrum methodologies.
  • Strong communication and interpersonal skills with the ability to lead a team.
Benefits

N Consulting Ltd offers a competitive salary, comprehensive benefits package, and opportunities for professional growth and development.



  • London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title: Senior Cloud Data Engineer with ETL ExpertiseLocation: RemoteDuration: ContractA highly skilled Senior Cloud Data Engineer is required to lead the design, development, and implementation of cloud-based data engineering solutions using AWS services such as S3, Glue, EMR, Athena, and Lambda. The ideal candidate will have hands-on experience with...


  • London, Greater London, United Kingdom Gentrack Full time

    Gentrack is a leading software company that provides innovative cleantech solutions to utilities worldwide. We are shaping the future of utilities by driving innovation, delivering great customer experiences, and securing profits.Our values are at the heart of everything we do: Respect for the planet, Respect for our customers, and Respect for each other. We...

  • Senior Data Architect

    3 weeks ago


    London, Greater London, United Kingdom With Intelligence Full time

    With Intelligence is a dynamic, product-led fintech company that empowers investors and managers worldwide by connecting them to the people and data they need to raise and allocate assets efficiently. Our mission is to be at the forefront of data-driven innovation.Job OverviewWe are seeking an experienced Senior Data Architect to lead our efforts in...


  • London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    **Overview of Role**We are seeking a highly skilled Senior Data Engineer to join our team at Data Idols. As a key member of our data function, you will be responsible for designing, building, and maintaining robust data pipelines that drive business growth.The successful candidate will have a strong background in data engineering, with expertise in data...

  • Data Engineer Leader

    12 hours ago


    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    **About Data Idols**Data Idols is a renowned retail brand in the UK, seeking an exceptional Senior Data Engineer to drive data transformation. As a Senior Data Engineer at Data Idols, you will play a pivotal role in delivering high-quality data solutions.The ideal candidate will have extensive experience with data pipelines, data warehousing, and cloud-based...


  • London, Greater London, United Kingdom With Intelligence Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Architecture Specialist to join our dynamic team at With Intelligence. This is an exciting opportunity for an experienced professional to lead the development and implementation of scalable data architectures, enabling our company to continue delivering high-quality intelligence to senior executives...


  • London, Greater London, United Kingdom Hays Specialist Recruitment Full time

    Job DescriptionThis role is available for hybrid working and when a hospital office presence is required, it will include working in Brighton and Hove particularly, and other NHS premises across East and West Sussex.The successful candidate will have expertise in writing ETL scripts and code and ensuring that the ETL process performs optimally. The role...


  • London, Greater London, United Kingdom With Intelligence Full time

    Data Engineer and Team LeadWe are rapidly expanding our focus on data, both internally and within our products and services. As a result, we need more help in this area to keep up with the growing demands of a dynamic, data-driven organisation.This role will oversee the development, maintenance, and optimization of ETL processes for data extraction,...

  • Senior Data Architect

    4 weeks ago


    London, Greater London, United Kingdom N Consulting Ltd Full time

    About the RoleData Engineer with TIBCON Consulting Ltd is seeking a highly skilled Data Engineer with expertise in Tibco to join our team. As a key member of our data engineering team, you will play a critical role in designing and implementing data pipelines for both party and contract data. You will also be responsible for ensuring data integrity and...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Science Festival is a leading entertainment organisation with a global presence, renowned for its innovative approach to data-driven decision making.Key ResponsibilitiesAs a Senior Data Warehouse Engineer, you will play a pivotal role in designing and implementing the company's data warehouse strategy.This involves working closely with the Data...


  • London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    **Career Opportunity**Join Data Idols as a Senior Data Engineer and take your career to the next level. As a key member of our data function, you will have the opportunity to design, build, and maintain complex data pipelines that drive business growth.The ideal candidate will have a strong background in data engineering, with expertise in cloud-based...

  • Data Engineer

    3 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...

  • Python Data Engineer

    1 month ago


    London, Greater London, United Kingdom Oliver Bernard Full time £80,000 - £120,000

    Senior Python Data Engineer - Python, AWS, ETLOliver Bernard is seeking a Senior Python Data Engineer to join our expanding Engineering Team on a Fully Remote basis.Key Skills and Experience:Prior experience in a Python Data Engineering roleStrong coding skills in PythonSQL expertiseCloud experience (AWS/Azure/GCP)Experience with ETL toolsSenior Python Data...

  • Senior Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Stanford Black Limited Full time

    We are seeking a Senior Data Engineer at Stanford Black Limited. Estimated salary: $160,000 per year. As a key member of our engineering team, you will be responsible for designing high-performance data platforms for macro trading, collaborating with data stakeholders and balancing business needs with scalability and performance.A strong knowledge of data...


  • London, Greater London, United Kingdom Aqovia Full time

    Cloud Data Engineer RoleWe are seeking a highly skilled Cloud Data Engineer to join our consulting projects team.The estimated salary for this role in London is £80,000 - £110,000 per annum.As a Cloud Data Engineer, you will be responsible for designing and building ETL data pipelines, developing and managing real-time and batch data pipelines, and...


  • London, Greater London, United Kingdom Austin Fraser Full time

    Job Title: Enterprise ETL ConsultantAustin Fraser is seeking an experienced Enterprise ETL Consultant to join our team. In this role, you will be responsible for designing and implementing ETL workflows to automate data processing tasks and ensuring seamless transition from legacy systems to modern platforms.About the Role:Lead and execute data migration...


  • London, Greater London, United Kingdom carwow Full time

    About Carwow GroupCarwow Group is a pioneering force in the automotive industry, dedicated to empowering drivers everywhere with innovative solutions. Our mission is to provide unparalleled car-changing experiences, leveraging cutting-edge technology and data-driven insights.Job DescriptionWe are seeking an exceptional Senior Data Architect and Engineer to...


  • London, Greater London, United Kingdom Arcus Search Full time

    Senior Data ArchitectWe're seeking a talented Senior Data Architect to join our team. This is an exciting opportunity to build a top-tier data infrastructure from scratch.As a key member of our data team, you will design and implement ETL processes to merge data from multiple sources into our cloud-based data warehouse.You'll partner with the business team...

  • Cloud Data Engineer

    11 hours ago


    London, Greater London, United Kingdom Carwow Full time

    We're looking for an experienced Cloud Data Engineer to join our team at Carwow. As a senior member of our data engineering practice, you'll lead the design, development, and maintenance of robust ETL/ELT data pipelines, write and optimise advanced SQL queries, and implement sophisticated data workflows using tools like Airflow.About the TeamOur team's...


  • London, Greater London, United Kingdom Carwow Full time

    At Carwow, we're driven by a passion for delivering exceptional customer experiences. Our mission is to empower teams with reliable, actionable data and enable informed decision-making through scalable and secure data platforms.About the RoleWe're seeking an experienced Data Engineering Leader to join our team. As a senior member of our data engineering...