Lead Big Data Solutions Architect

1 week ago


London, Greater London, United Kingdom CV Library Full time
About the Job

We are looking for a talented Lead Big Data Solutions Architect to lead the development of our data Lakehouse platform at CV Library in London/Hybrid. The ideal candidate will have extensive experience with big data technologies.

The estimated salary for this role is up to £580 per day INSIDE IR35. We offer a 12-month contract initially + extensions.

Job Description:
  1. Lead the design, development, and implementation of data engineering solutions for our data Lakehouse platform.
  2. Optimize big data workloads in Spark and other big data technologies.
  3. Manage CI/CD pipelines using Azure DevOps or Git.

Required Skills/Experience:

  • Extensive experience with Databricks, Apache Spark, and data lakes.
  • Proficiency in Python and SQL.
  • Experience with CI/CD processes using Azure DevOps or Git.

Desired Skills/Experience:

  • Experience working in Energy trading related projects.
  • Familiarity with automation testing frameworks.


  • London, Greater London, United Kingdom Xcede Group Full time

    About the RoleXcede Group is a leading provider of innovative financial solutions, and we are now seeking a highly skilled Big Data Solutions Architect to join our team.This is a unique opportunity to work with a talented group of professionals and contribute to the design and implementation of cutting-edge Big Data solutions.The ideal candidate will have a...

  • Big Data Architect

    2 weeks ago


    London, Greater London, United Kingdom Endeavour Recruitment Solutions Full time

    Job DescriptionWe are looking for a Big Data Architect to join our team at Endeavour Recruitment Solutions. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data architectures to support our client's innovative digital marketing agency.This is an excellent opportunity for experienced Data...


  • London, Greater London, United Kingdom JobHoller Full time

    Job DescriptionWe are looking for a highly experienced Lead Big Data Solutions Architect to lead our cyber team in designing and developing software solutions.The successful candidate will have a strong understanding of DevSecOps automated deployment tools such as Jenkins, Ansible, Docker.Additionally, experience working in an Agile Scrum environment with...


  • London, Greater London, United Kingdom NTT DATA Full time

    NTT DATA seeks a seasoned professional to spearhead its data architecture efforts.Job OverviewA unique opportunity has arisen for an experienced Data Solutions Architect Lead to join our dynamic team in a remote-first environment. This role entails designing and delivering cloud-based data solutions utilizing best-in-class RDBMS, ETL/ELT, and Cloud platforms...


  • London, Greater London, United Kingdom Northrop Grumman Corp. (AU) Full time

    Northrop Grumman Corp. (AU) is seeking a Lead Big Data Solutions Architect to join our team. As a key member of our digital transformation programme, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.The ideal candidate will have a strong background...


  • London, Greater London, United Kingdom Coatue Management L.L.C. Full time

    About the Role:We are looking for a Big Data Solutions Architect to join our team at Coatue Management L.L.C. in London.Responsibilities:Guide customers in building big data solutions on Databricks that span a large variety of use cases.Work with and support Solution Architects, requiring hands-on production experience with cloud infrastructure and big data...


  • London, Greater London, United Kingdom Norton Blake Full time

    Norton Blake is looking for a highly skilled GCP Big Data Solutions Architect to design and implement scalable data solutions using Google Cloud Platform.The ideal candidate will have experience with big data technologies, including Big Query, DataProc, and Big Table, as well as pub/sub and Spanner.Responsibilities:


  • London, Greater London, United Kingdom Hitachi Vantara Corporation Full time

    Company Overview:We are GlobalLogic, a leader in digital engineering. We help brands across the globe design and build innovative products, platforms, and digital experiences for the modern world.As a pioneer in this field, we have developed a comprehensive portfolio of solutions that enable businesses to stay ahead of the curve. Our team consists of experts...

  • Big Data Architect

    2 weeks ago


    London, Greater London, United Kingdom WorksHub Full time

    WorksHub is a leading technology company that specializes in delivering innovative data solutions to businesses. We are currently seeking a Big Data Architect to join our team in London and lead the design and implementation of our data architecture.The successful candidate will have a strong background in big data technologies, including Spark, Kafka, and...


  • London, Greater London, United Kingdom InterEx Group Full time

    InterEx Group is seeking a Big Data Architect Manager to lead our big data architecture efforts. As a Big Data Architect Manager, you will be responsible for designing and implementing big data architectures that meet the needs of our clients.You will work closely with our clients to understand their big data requirements and develop tailored solutions that...


  • London, Greater London, United Kingdom Amazon Full time

    About the RoleAmazon Web Services is seeking an experienced Big Data Solutions Architect to join their team. As a key member of the AWS Solutions Architecture team, you will work closely with customers to design and implement cloud-based solutions using EMR, Glue, and Data Zone. With your extensive knowledge in big data analytics, cloud computing, and IT...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    About the PositionDatabricks Inc. is seeking a seasoned Cloud Engineering Director to lead our pre-sales team in the UK&I region. As a key member of our leadership team, you will be responsible for driving revenue growth, developing strategic solutions, and mentoring a team of Solutions Architects.This is an exceptional opportunity to join a fast-growing...


  • London, Greater London, United Kingdom Kingfisher Full time

    We are seeking a highly motivated and experienced Lead Big Data Architect to lead our data engineering team at Kingfisher. As a Senior Data Engineer, you will be responsible for providing technical leadership and guidance on all aspects of data engineering practices.The ideal candidate will have extensive experience in building large-scale distributed data...


  • London, Greater London, United Kingdom Amazon Full time

    As a Data Architect for Scalable Big Data Solutions at Amazon, you will play a crucial role in designing and implementing next-generation data pipelines and BI solutions. This position requires profound experience in designing, implementing, and overseeing data processing systems tailored for extensive datasets.About the JobThe ideal candidate will have a...


  • London, Greater London, United Kingdom N Consulting Limited Full time

    Job Summary: We are looking for an experienced AWS Big Data Solutions Architect to join our team at N Consulting Limited. The ideal candidate will have a strong background in designing and implementing large-scale data systems on AWS.About the Role:The successful candidate will be responsible for designing and implementing scalable data architectures on AWS,...


  • London, Greater London, United Kingdom Data Careers Ltd Full time

    At Data Careers Ltd, we are looking for a seasoned Data Solutions Architect to lead our presales efforts. This role involves working closely with our Sales Team to engage with customers and articulate the value proposition of our technology services.The ideal candidate will have experience in developing dashboards and analytics solutions using Azure Data...

  • Big Data Architect

    1 day ago


    London, Greater London, United Kingdom Pearson Full time

    **Project Description**We are initiating a new programme that will hold large amounts of data hosted in AWS and platforms such as MySQL. As a Big Data Architect, you will be responsible for working with business SMEs, product owners, architects, and developers to design and develop complex data transformation projects.


  • London, Greater London, United Kingdom BGL Group Full time

    Job Summary:We are seeking a Senior Data Architect - Big Data to lead the development of our cloud-based data infrastructure. The successful candidate will be responsible for designing and implementing scalable data pipelines and architectures that support business growth.Key Responsibilities:Lead the design and implementation of big data architectures that...


  • London, Greater London, United Kingdom ZipRecruiter Full time

    Required Skills and Qualifications: We are looking for an exceptional Big Data Technical Lead with a deep understanding of big data technologies, including PySpark and SQL. You will be responsible for leading the development of a cutting-edge data platform, ensuring high-quality delivery, and mentoring junior engineers.About the Role:Lead the development of...


  • London, Greater London, United Kingdom Fifty-Five Full time

    About Fifty-FiveFifty-Five is a forward-thinking technology organization dedicated to harnessing the power of data to drive business growth. We are currently seeking an accomplished Big Data Solutions Architect to spearhead the development of innovative data solutions on Google Cloud Platform (GCP).Job DescriptionThe ideal candidate will have a deep...