Senior Data Engineer

3 weeks ago

London, Greater London, United Kingdom IO Associates Full time

We are seeking a highly skilled Data Engineer to join our team at IO Associates. As a key member of our data science team, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.

Key responsibilities include:

  • Designing and implementing scalable big data systems
  • Ensuring seamless data integration, security, and compliance with GDPR and privacy regulations
  • Optimizing data pipelines and orchestration processes
  • Collaborating with cross-functional teams to ensure successful project delivery

Requirements include:

  • Proven experience in scripting languages such as Python, Bash, or similar
  • Experience with integration testing and ensuring seamless tool integration
  • In-depth knowledge of Linux internals and system administration
  • Hands-on experience with data pipeline tools like NiFi and Airflow
  • Proven ability to design scalable big data systems with a focus on security and GDPR compliance
  • Hybrid cloud experience, specifically with on-premise and AWS cloud environments

Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK is also desirable. Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch is a plus. Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI is also required. Certification in AWS or other cloud platforms is a bonus.

We are looking for a highly skilled and experienced Data Engineer who can join our team and contribute to the success of our data science projects. If you have a passion for big data and a strong background in data engineering, we encourage you to apply for this exciting opportunity.

  • Senior Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Senior Data EngineerJoin Data Idols as a Senior Data Engineer and support the delivery of data transformation during an exciting time. You will collaborate with the wider data teams to build and maintain reliable and high-quality data solutions. Strong experience in Python is required. You will play a key role in driving high standards across the data...

  • Senior Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Senior Data EngineerJoin Data Idols, one of the UK's most renowned retail brands, as a Senior Data Engineer and play a pivotal role in shaping the company's data transformation journey.We're seeking an experienced professional with a strong background in building and maintaining data pipelines and collaborating with cross-functional data teams.As a Senior...

  • Senior Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Senior Data EngineerJoin Data Idols, one of the UK's most renowned retail brands, as a Senior Data Engineer and play a pivotal role in shaping the company's data transformation journey.We're seeking an experienced professional with a strong background in building and maintaining data pipelines and collaborating with cross-functional data teams.As a Senior...

  • Senior Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Unlock Your Potential as a Senior Data EngineerJoin Data Idols, a renowned retail brand, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. Collaborate with the wider data teams to build and maintain data pipelines that drive high standards across the data function.The OpportunityAs a Senior...

  • Senior Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Senior Data EngineerJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and play a pivotal role in shaping the company's data transformation journey. We're seeking an experienced professional with a strong background in building and maintaining data pipelines to collaborate with our data teams.Key Responsibilities:Design and...

  • Senior Data Engineer

    2 months ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Unlock Data-Driven Decision MakingJoin Data Idols as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting time. Collaborate with the wider data teams to build and maintain reliable and high-quality data solutions.The OpportunityAs a Senior Data Engineer, you will play a key role in driving high standards across the...

  • Senior Data Engineer

    2 months ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Unlock Data-Driven Decision MakingJoin Data Idols as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting time. Collaborate with the wider data teams to build and maintain reliable and high-quality data solutions.The OpportunityAs a Senior Data Engineer, you will play a key role in driving high standards across the...

  • Senior Data Engineer

    4 days ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Data Engineering Role at Data IdolsJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. The ideal candidate will have extensive experience in building and maintaining data pipelines and collaborating with cross-functional data teams.About the...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    About the RoleData Idols is seeking a highly skilled Senior Data Engineer to join their team. As a key member of the data team, you will be responsible for designing and implementing data pipelines and data warehousing solutions using Azure and Spark.The OpportunityThis is an exciting opportunity for a talented Data Engineer to play a key role in driving...

  • Senior Data Engineer

    3 weeks ago

    London, Greater London, United Kingdom Applied Data Science Partners Full time

    Applied Data Science Partners is a leading data science consultancy based in London. We are seeking a Senior Data Engineer to join our team.This is an exciting opportunity for a skilled professional to contribute to our client deliverables and experiment with cutting-edge techniques. As a Senior Data Engineer, you will be responsible for designing and...

  • Senior Data Engineer

    1 month ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our expanding data team. As a Senior Data Engineer, you will be responsible for building and maintaining our AWS platform, working with stakeholders to understand data collected, and implementing best coding practices using CI/CD pipelines.Key...

  • Senior Data Engineer

    1 month ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our expanding data team. As a Senior Data Engineer, you will be responsible for building and maintaining our AWS platform, working with stakeholders to understand data collected, and implementing best coding practices using CI/CD pipelines.Key...

  • Senior Data Engineering Specialist

    7 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Senior Data EngineerAt Data Science Festival, we are seeking an experienced Senior Data Engineer to join our team. As a key member of our data function, you will be responsible for building and maintaining high-quality data solutions to support our data-driven decision-making processes.Key responsibilities include:Designing and implementing data pipelines...

  • Senior Data Architect

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Senior Data EngineerJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. We are seeking an experienced professional with a strong background in building and maintaining data pipelines to collaborate with our data teams.Key...

  • Senior Data Architect

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Senior Data EngineerJoin Data Idols, a renowned retail brand in the UK, as a Senior Data Engineer and contribute to the delivery of data transformation during an exciting period of growth. We are seeking an experienced professional with a strong background in building and maintaining data pipelines to collaborate with our data teams.Key...

  • Senior Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our expanding data team. As a Senior Data Engineer, you will be responsible for building and maintaining our AWS platform, working with stakeholders to understand data collected, and implementing best coding practices using CI/CD pipelines.Key...

  • Senior Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our expanding data team. As a Senior Data Engineer, you will be responsible for building and maintaining our AWS platform, working with stakeholders to understand data collected, and implementing best coding practices using CI/CD pipelines.Key...

  • Senior Data Scientist, Data Engineering Expert

    4 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Senior Data EngineerAs a Senior Data Engineer at Data Science Festival, you will play a key role in shaping the company's data transformation strategy. Your expertise in building and maintaining data pipelines will be invaluable in driving high standards across the data function. You will build reliable and high-quality data solutions, supporting the team in...

  • Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    Unlock Your Potential as a Data EngineerAt Houseful, we're on a mission to empower individuals to make informed decisions about their homes. As a leading property brand, we're committed to leveraging data and technology to drive the property market forward.About the RoleWe're seeking an experienced Data Engineer to join our team. As a key member of our data...

  • Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    Unlock Your Potential as a Data EngineerAt Houseful, we're on a mission to empower individuals to make informed decisions about their homes. As a leading property brand, we're committed to leveraging data and technology to drive the property market forward.About the RoleWe're seeking an experienced Data Engineer to join our team. As a key member of our data...