Senior Big Data Engineer

4 weeks ago


London, Greater London, United Kingdom HCLTech Full time

Join HCLTech's team of innovators and shape the future of data engineering. As a Senior Data Engineer, you will work on cutting-edge projects that leverage big data technologies, cloud computing, and artificial intelligence.

**About the Role:**

This is a high-impact position that requires a strong technical background, business acumen, and excellent communication skills. You will collaborate with cross-functional teams to design and implement data solutions that drive business outcomes.

**Responsibilities:

  • Develop and maintain large-scale data systems using big data technologies like Hadoop, Spark, and NoSQL databases.
  • Design and implement data pipelines using StreamSets and Kafka.
  • Collaborate with data scientists to develop risk-based scoring algorithms and predictive models.
  • Ensure data quality, security, and compliance with regulatory requirements.

**Requirements:

  • Minimum 15 years of experience in the IT industry, preferably in Banking & Financial Services.
  • Strong expertise in databases (RDBMS, NoSQL), SQL, StreamSets, Kafka, Python, and data-on-cloud technologies.
  • Good knowledge of data streaming patterns and tools like StreamSets and Kafka.

**Salary:** $170,000 - $240,000 per year, depending on location and experience.



  • London, Greater London, United Kingdom SR2 | Socially Responsible Recruitment | Certified B Corporation™ Full time

    Data Engineering Career Opportunity:Sr2 is seeking a seasoned Senior Big Data Engineer to lead our data engineering efforts in London. As a senior member of the team, you will oversee the design, development, and implementation of large-scale data systems, ensuring they are efficient, reliable, and meet the needs of our clients.The ideal candidate will have...


  • London, Greater London, United Kingdom Alphasights Full time

    Are you passionate about solving complex data challenges? Do you enjoy collaborating with talented colleagues in a fast-paced environment?About the Role:We're seeking a highly skilled Senior Big Data Engineer to expand our Engineering team in London. As a Senior Big Data Engineer, you will be responsible for designing, developing, and deploying scalable data...


  • London, Greater London, United Kingdom Xcede Group Full time

    As a Senior Big Data Engineer at Xcede Group, you will have the opportunity to design, build and implement advanced big data solutions. Our Multi-Strategy Hedge Fund client is looking for an experienced software engineer/data engineer to work closely with trading, quant research, and technology teams.Key ResponsibilitiesDesign and implement ETL/ELT data...


  • London, Greater London, United Kingdom JPMorganChase Full time

    We are looking for a skilled Senior Big Data Developer to join our team at JPMorgan Chase. In this role, you will be responsible for designing and developing big data solutions using cloud-based technologies such as AWS.The estimated salary for this position is $150,000 - $200,000 per year, depending on experience. As a Senior Big Data Developer, you will...


  • London, Greater London, United Kingdom WorksHub Full time

    As a Senior Big Data Specialist at WorksHub, you will play a key role in designing and implementing our big data solutions.We are offering a competitive salary of £150,000 - £220,000 per year.You will be responsible for developing software applications using Python or Scala and have a strong understanding of big data technologies like Spark and message...

  • Big Data Engineer

    3 weeks ago


    London, Greater London, United Kingdom Xcede Group Full time

    Job Summary: Xcede Group is seeking a talented Big Data Engineer to join our team in London. As a Big Data Engineer, you will be responsible for designing, building, and implementing big data solutions to enable the capture, ingestion, storage, and provision of terabyte-sized alternate datasets. You will work closely with Trading, Quant Research, and...

  • Senior Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Ogury Ltd Full time

    Ogury Ltd, a global adtech company, is seeking an experienced Senior Data Engineer - Big Data Platform. This role requires a strong background in building scalable data solutions and expertise in cloud providers. The successful candidate will be responsible for defining the long-term vision and leading the execution of Ogury's data platform.About the...

  • Big Data Engineer

    3 weeks ago


    London, Greater London, United Kingdom ADLIB Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at ADLIB. The ideal candidate will have experience with Databricks and SQL, as well as strong communication skills.About the Role:Lead the migration of data from legacy DB to Databricks.Design, implement, and optimize data pipelines using Databricks, PySpark, and...


  • London, Greater London, United Kingdom Source Technology Full time

    Job Details:Job Title: Engineering Lead for Big DataWe are seeking an experienced Engineering Lead for Big Data to lead our team in delivering next-generation big data infrastructure and enabling advanced AI/ML capabilities. The successful candidate will have a strong background in data engineering, Azure data services, and leading high-performing teams.Key...


  • London, Greater London, United Kingdom Wyatt Partners Full time

    JOB TITLE: Senior Data Engineering Lead at Wyatt PartnersAbout UsWe are a leading gaming company, committed to pushing the boundaries of innovation through cutting-edge technology.About the RoleWe are seeking a senior data engineering lead to oversee the development and deployment of big data initiatives, drive business growth through data-driven insights,...

  • Senior Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Tesco Partners Full time

    As a Senior Data Platform Engineer with Tesco Partners, you will have the opportunity to work on a wide range of projects, designing and implementing data architectures, integrating data from various sources, and contributing to the development of high-quality code. Our ideal candidate will have strong technical skills, particularly in cloud services like...


  • London, Greater London, United Kingdom JobHoller Full time

    About JobHollerWe are a leading national security company recruiting for a talented Lead Big Data Engineer to join our team in central London. This is a permanent opportunity with a salary of up to £90,000 plus clearance bonus.You will be working on designing and developing packages of work within our cyber team using big data tools such as Hadoop, Cloudera...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    The Perfect CandidateAs a Senior Data Platform Engineer, you'll have:Expertise in Azure Data Lake Storage, Azure Compute, and Azure Databricks.A strong understanding of DevOps practices, using tools like Azure DevOps, Jenkins, or GitHub Actions.Solid knowledge of security best practices on Azure, including identity and access management, network security,...

  • Big Data Architect

    4 weeks ago


    London, Greater London, United Kingdom Source Technology Full time

    At Source Technology, we are seeking an experienced Big Data Architect to play a key role in transforming how data is managed and utilised, supporting a multi-year program designed to deliver next-generation big data infrastructure and enable advanced AI/ML capabilities.We are looking for a Senior Data Engineer with a strong background in trading and...


  • London, Greater London, United Kingdom FinTop Consulting Full time

    Job DescriptionWe are seeking a highly skilled Big Data Engineering Lead to join our team at FinTop Consulting. In this role, you will be responsible for leading the development and implementation of our big data engineering initiatives.About the RoleDevelop and implement modern data architecture, including working with Databricks, DBT, and cloud platforms...


  • London, Greater London, United Kingdom IBU Consulting Full time

    Job Title: Big Data Engineering LeaderWe are seeking an experienced Big Data Engineering Leader to join our team at IBU Consulting.The successful candidate will be responsible for leading the development and implementation of big data engineering solutions using Microsoft Fabric core features, including Azure Data Lake, Azure Synapse Data Warehouse, and...


  • London, Greater London, United Kingdom Athsai Full time

    Athsai is looking for a highly skilled Lead Big Data Engineer to oversee the design, development, and deployment of large-scale data engineering projects. This is an excellent opportunity for a qualified professional to showcase their technical expertise and leadership skills.You will work closely with cross-functional teams to deliver complex data...


  • London, Greater London, United Kingdom Computappoint Full time £90,000

    Job Overview:We are seeking a highly skilled Senior Data Engineer to join our AI and Data practice at Computappoint. As a leader in your field, you will be responsible for the deployment, optimization, and maintenance of our Starburst and Dell Data Lakehouse installations.About the Job:Designing and implementing our cloud-based data architectureDeployment,...


  • London, Greater London, United Kingdom WeShape Full time

    As a Senior Big Data Specialist at WeShape, you will play a critical role in designing and developing our new real-time data platform. This exciting opportunity involves working with fast-moving and large-volume data in cloud-based data and analytics platforms.The ideal candidate will have deep knowledge and experience with data streaming, data lakehouses,...

  • Senior Data Architect

    3 weeks ago


    London, Greater London, United Kingdom BGL Group Full time

    Job Summary:We are seeking a Senior Data Architect - Big Data to lead the development of our cloud-based data infrastructure. The successful candidate will be responsible for designing and implementing scalable data pipelines and architectures that support business growth.Key Responsibilities:Lead the design and implementation of big data architectures that...