Big Data Specialist

6 days ago

London, Greater London, United Kingdom Capgemini Full time

About the Role

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.

Your Key Responsibilities

  • Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.
  • Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data.
  • Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive models and drive business insights.
  • Monitor and optimize data pipelines and infrastructure: Analyze performance metrics, identify bottlenecks, and implement optimizations for efficiency and scalability.
  • Collaborate with cross-functional teams: Work closely with business analysts, data scientists, and DevOps engineers to ensure successful data platform implementations.
  • Stay ahead of the curve: Continuously learn and adapt to the evolving landscape of big data technologies and best practices.

Your Skills and Experience

  • Minimum 3+ years of experience as a Data Engineer or similar role.
  • Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.
  • Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory.
  • Knowledge of SQL and scripting languages like Python or Scala and hands-on experience with AI/ML concepts and tools.
  • Excellent problem-solving and analytical skills and strong communication and teamwork skills.
  • Passion for data and a thirst for learning.

About Capgemini

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided every day by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 360,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast-evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering, and platforms. The Group reported 2023 global revenues of €22.5 billion.

  • Big Data Specialist

    7 days ago

    London, Greater London, United Kingdom Saragossa Full time £150,000

    About the RoleWe are seeking a highly skilled Pensions Developer to join our team at Saragossa, a global Multistrat Hedge Fund. As a key member of our Risk Engineering Team, you will play a critical role in designing, developing, and implementing Big Data and real-time applications.Key ResponsibilitiesDesign and develop risk platforms to support our business...

  • Big Data Engineer

    21 hours ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Hadoop, Spark, and NoSQL databases.Develop and implement data...

  • Big Data Engineer

    18 hours ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Hadoop, Spark, and NoSQL databases.Develop and implement data...

  • Big Data Analyst

    1 month ago

    London, Greater London, United Kingdom Nexus Jobs Limited Full time

    Job Description Big Data Scientist - Docklands LondonOur Client an international organisation is looking to recruit a Big Data Expert with 2 to 5 years expertise as a Big Data Scientist.You will have Natural Language Processing (NLP) knowledge and experience and understand and analyse large data sets to discover new insights.Working in a multi-disciplinary...

  • Big Data Architect

    7 days ago

    London, Greater London, United Kingdom InterEx Group Full time

    Job DescriptionFor this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data.Key Responsibilities:Design and implement Big Data and Data Analytics solutions that meet customer requirements.Develop high-quality, engaging customer presentations and communicate effectively at the...

  • Big Data Architect

    1 week ago

    London, Greater London, United Kingdom Hunter Bond Full time

    About the RoleWe are seeking a highly skilled and experienced Big Data Architect to join our team at Hunter Bond. As a key member of our organization, you will be responsible for providing technical leadership in architecting and designing end-to-end solutions for our data lake initiatives.Key ResponsibilitiesProvide technical leadership in architecting and...

  • Big Data Analyst

    1 week ago

    London, Greater London, United Kingdom InPost UK Full time

    About InPost UKInPost UK is a leading out-of-home business that is revolutionizing the delivery universe. We are a fast-paced and global company that is committed to providing innovative solutions for e-commerce delivery.Job SummaryWe are seeking a highly skilled Data Insights Specialist to join our team. As a Data Insights Specialist, you will be...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data LeadCompany: Hunter BondJob Type: Full-timeLocation: Remote (London office)About the Role:We are seeking a highly skilled Big Data Architect to lead our data engineering team in designing and implementing end-to-end solutions for our datalake initiatives. As a key member of our team, you will be responsible for providing technical...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data LeadCompany: Hunter BondJob Type: Full-timeLocation: Remote (London office)About the Role:We are seeking a highly skilled Big Data Architect to lead our data engineering team in designing and implementing end-to-end solutions for our datalake initiatives. As a key member of our team, you will be responsible for providing technical...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    About Hunter BondHunter Bond is a leading provider of innovative data solutions, and we're seeking a talented Big Data Architect to join our team in London. As a key member of our engineering team, you'll play a crucial role in designing and implementing end-to-end data solutions that drive business growth and improvement.Job SummaryWe're looking for a...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    About Hunter BondHunter Bond is a leading provider of innovative data solutions, and we're seeking a talented Big Data Architect to join our team in London. As a key member of our engineering team, you'll play a crucial role in designing and implementing end-to-end data solutions that drive business growth and improvement.Job SummaryWe're looking for a...

  • Big Data Solutions Architect

    1 week ago

    London, Greater London, United Kingdom Amazon Full time

    Job Title: Big Data Solutions ArchitectAbout the Role:We are seeking a highly skilled Big Data Solutions Architect to join our team at Amazon. As a key member of our team, you will be responsible for designing and implementing scalable, secure, and highly available big data solutions for our customers.Key Responsibilities:Collaborate with cross-functional...

  • Big Data Solutions Architect

    6 days ago

    London, Greater London, United Kingdom Amazon Full time

    Job Title: Big Data Solutions ArchitectAbout the Role:We are seeking a highly skilled Big Data Solutions Architect to join our team at Amazon. As a key member of our team, you will be responsible for designing and implementing scalable, secure, and highly available big data solutions for our customers.Key Responsibilities:Collaborate with cross-functional...

  • Senior Cloud Data Architect

    1 week ago

    London, Greater London, United Kingdom Pioneer Search Full time

    Pioneer Search is seeking a highly skilled GCP Data Architect to join our team as a Technical Lead. As a key member of our engineering and architecture function, you will play a crucial role in designing and implementing a robust GCP Data Architecture for our big data environment.About the Role:Work within a GCP environment to deliver technical solutions and...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data LeadAbout the Role:Hunter Bond is seeking a highly skilled Big Data Lead to join our team in London. As a key member of our organization, you will be responsible for providing technical leadership in architecting and designing end-to-end solutions for our datalake initiatives.Key Responsibilities:Provide technical leadership in...

  • Big Data Architect

    5 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data LeadAbout the Role:Hunter Bond is seeking a highly skilled Big Data Lead to join our team in London. As a key member of our organization, you will be responsible for providing technical leadership in architecting and designing end-to-end solutions for our datalake initiatives.Key Responsibilities:Provide technical leadership in...

  • Big Data Developer

    6 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data DeveloperAbout Us: Hunter Bond is a leading organization in the industry, and we're looking for a talented Big Data Developer to join our team.Job Summary: We're seeking a skilled Big Data Developer to provide technical expertise in designing and developing end-to-end solutions for our datalake initiatives. As a Big Data Developer, you'll...

  • Big Data Developer

    6 days ago

    London, Greater London, United Kingdom Hunter Bond Full time

    Job Title: Big Data DeveloperAbout Us: Hunter Bond is a leading organization in the industry, and we're looking for a talented Big Data Developer to join our team.Job Summary: We're seeking a skilled Big Data Developer to provide technical expertise in designing and developing end-to-end solutions for our datalake initiatives. As a Big Data Developer, you'll...

  • Big Data Architect

    1 week ago

    London, Greater London, United Kingdom Hunter Bond Full time

    **Job Title:** Big Data Lead**Job Summary:** Hunter Bond is seeking a highly skilled Big Data Lead to join our team in London. As a key member of our organization, you will be responsible for providing technical leadership in architecting and designing end-to-end solutions for our datalake initiatives.**Key Responsibilities:**Provide technical leadership in...

  • Big Data Systems Architect

    7 days ago

    London, Greater London, United Kingdom Northrop Grumman Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team at Northrop Grumman UK. As a key member of our Cyber & Intelligence business, you will play a critical role in designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key...