Big Data Infrastructure Developer
4 weeks ago
About the Job:
We are seeking a talented individual to fill the role of Big Data Infrastructure Developer with our client in the Financial Services sector. The successful candidate will have extensive experience in building or architecting data pipelines in Spark and setting up Kafka environments.
About the Role:
This is an exciting opportunity to work with a leading consulting client in the Financial Services sector. You will be responsible for designing and implementing data pipelines using Spark and setting up their new Kafka environment.
Key Responsibilities:
- Design and implement data pipelines to move data from legacy systems to a new data warehouse
- Set up the new Kafka environment
- Collaborate with cross-functional teams to ensure smooth project execution
Requirements:
- Strong understanding of Spark and Kafka technologies
- Experience in data warehousing concepts
- Excellent problem-solving skills
Salary: £650-850 per annum, depending on experience.
-
Big Data Infrastructure Specialist
3 weeks ago
London, Greater London, United Kingdom Source Technology Full timeAbout the RoleWe are seeking a Big Data Infrastructure Specialist to join our team at Source Technology. As a key member of our Data Engineering Team, you will be responsible for designing, implementing, and maintaining big data infrastructure that supports critical business and data science projects.The ideal candidate will have a strong background in big...
-
Big Data Infrastructure Lead
4 weeks ago
London, Greater London, United Kingdom S&P Global Full timeAbout the Team:S&P Global Market Intelligence is a division of S&P Global, a leading provider of data and analytics solutions for the financial industry. We understand the importance of accurate, deep, and insightful information and are committed to delivering unrivaled insights and leading data and technology solutions.The Job Description: As a Senior...
-
Big Data Pipeline Developer
4 weeks ago
London, Greater London, United Kingdom Xcede Recruitment Solutions Full timeJob Title: Big Data Pipeline DeveloperXcede Recruitment Solutions is hiring a skilled Big Data Pipeline Developer to create efficient and scalable data pipelines for a leading AI Scale Up in Medical Technology/Digital Health.About the Job:Develop and maintain big data pipelines using Python, Java, or other programming languages.Create data visualisation...
-
Big Data Infrastructure Specialist
3 weeks ago
London, Greater London, United Kingdom Computappoint Full time £70,000About the JobComputappoint Limited is seeking a talented Data Engineer to join their AI and Data practice. As a key member of the team, you will be responsible for designing, implementing, and maintaining large-scale data infrastructure using Starburst and other technologies.Responsibilities Include:Developing and deploying data pipelines using...
-
Big Data Developer
2 weeks ago
London, Greater London, United Kingdom WeAreTechWomen Full timeAbout the Opportunity:WeAreTechWomen is looking for a Big Data Developer to join our Financial Risk Analytics team. As a developer, you will play a key role in building state-of-the-art financial analytics software using a Spark platform.The successful candidate will have a strong background in software development and experience working with distributed...
-
Big Data Architect
4 weeks ago
London, Greater London, United Kingdom Source Technology Full timeAt Source Technology, we are seeking an experienced Big Data Architect to play a key role in transforming how data is managed and utilised, supporting a multi-year program designed to deliver next-generation big data infrastructure and enable advanced AI/ML capabilities.We are looking for a Senior Data Engineer with a strong background in trading and...
-
Big Data Analytics Infrastructure Specialist
2 weeks ago
London, Greater London, United Kingdom MBR Partners Full timeJob DescriptionWe are seeking an experienced AWS Data Architect to lead our Cloud Native Big Data Analytics infrastructure layer design and implementation. This role involves designing and supporting the backbone for AI/ML workflows, enabling both real-time and batch processing for training and inference purposes. The typical data throughput to support is in...
-
AWS Big Data Infrastructure Lead
2 months ago
London, Greater London, United Kingdom LinuxRecruit Full timeLinuxRecruit is seeking an experienced AWS Big Data Infrastructure Lead to oversee the deployment and management of our core technical infrastructure. Based in the UK, this fully remote position offers a competitive salary of £100,000 - £130,000 per annum.You'll be responsible for constructing ETL pipelines using Glue and Spark, while leveraging Power BI...
-
Engineering Lead for Big Data
3 weeks ago
London, Greater London, United Kingdom Source Technology Full timeJob Details:Job Title: Engineering Lead for Big DataWe are seeking an experienced Engineering Lead for Big Data to lead our team in delivering next-generation big data infrastructure and enabling advanced AI/ML capabilities. The successful candidate will have a strong background in data engineering, Azure data services, and leading high-performing teams.Key...
-
Big Data Engineer
4 weeks ago
London, Greater London, United Kingdom Xcede Full timeJob Summary: Xcede is seeking a Big Data Engineer to join our team in London. The successful candidate will be responsible for designing and implementing scalable big data architectures, ensuring the quality and security of data processes, and collaborating with cross-functional teams to deliver projects.Key Responsibilities: Design, build, and maintain...
-
Senior Data Infrastructure Developer
4 weeks ago
London, Greater London, United Kingdom Northern Data Group Full timeAbout the RoleWe are excited to announce a new opportunity for a Senior Data Infrastructure Developer to join our team at Northern Data Group. In this role, you will play a critical part in designing, building, and maintaining our data infrastructure.Main Responsibilities:Develop and maintain end-to-end data pipelines, focusing on performance, scalability,...
-
Senior Big Data Engineer
2 weeks ago
London, Greater London, United Kingdom Alphasights Full timeAre you passionate about solving complex data challenges? Do you enjoy collaborating with talented colleagues in a fast-paced environment?About the Role:We're seeking a highly skilled Senior Big Data Engineer to expand our Engineering team in London. As a Senior Big Data Engineer, you will be responsible for designing, developing, and deploying scalable data...
-
Big Data Systems Expert
2 weeks ago
London, Greater London, United Kingdom Apple Inc. Full timeShape the Future of Big Data Systems with AppleWe are seeking a seasoned expert in big data systems to join our team at Apple Inc. As a Big Data Systems Expert, you will be responsible for designing, building, and maintaining scalable big-data systems that power our AI and ML solutions.Your expertise will be invaluable in improving the performance,...
-
Big Data Infrastructure Specialist
3 weeks ago
London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000The Perfect CandidateAs a Senior Data Platform Engineer, you'll have:Expertise in Azure Data Lake Storage, Azure Compute, and Azure Databricks.A strong understanding of DevOps practices, using tools like Azure DevOps, Jenkins, or GitHub Actions.Solid knowledge of security best practices on Azure, including identity and access management, network security,...
-
Big Data and Azure Expert
4 weeks ago
London, Greater London, United Kingdom Middleware Talents Ltd Full timeAbout the Role:We are seeking an experienced Big Data and Azure Expert to join our team in London. As a key member of our architecture team, you will be responsible for designing and implementing large-scale cloud infrastructure solutions using Microsoft Azure. Your expertise in big data, database, and data warehouse architecture is highly valued. You will...
-
Senior Data Infrastructure Developer
4 weeks ago
London, Greater London, United Kingdom DATAHEAD Full timeAbout the RoleThis Senior Data Infrastructure Developer position is responsible for designing and implementing scalable data pipelines to support business growth. The ideal candidate will have expertise in big data technologies and cloud platforms.Key Responsibilities:Design and develop robust data pipelines and ETL processesCollaborate with data scientists...
-
Senior Data Architect
2 weeks ago
London, Greater London, United Kingdom BGL Group Full timeJob Summary:We are seeking a Senior Data Architect - Big Data to lead the development of our cloud-based data infrastructure. The successful candidate will be responsible for designing and implementing scalable data pipelines and architectures that support business growth.Key Responsibilities:Lead the design and implementation of big data architectures that...
-
Senior Big Data Developer
4 weeks ago
London, Greater London, United Kingdom JPMorganChase Full timeWe are looking for a skilled Senior Big Data Developer to join our team at JPMorgan Chase. In this role, you will be responsible for designing and developing big data solutions using cloud-based technologies such as AWS.The estimated salary for this position is $150,000 - $200,000 per year, depending on experience. As a Senior Big Data Developer, you will...
-
Big Data Solutions Architect
2 weeks ago
London, Greater London, United Kingdom Coatue Management L.L.C. Full timeAbout the Role:We are looking for a Big Data Solutions Architect to join our team at Coatue Management L.L.C. in London.Responsibilities:Guide customers in building big data solutions on Databricks that span a large variety of use cases.Work with and support Solution Architects, requiring hands-on production experience with cloud infrastructure and big data...
-
Big Data Engineer
2 weeks ago
London, Greater London, United Kingdom ADLIB Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at ADLIB. The ideal candidate will have experience with Databricks and SQL, as well as strong communication skills.About the Role:Lead the migration of data from legacy DB to Databricks.Design, implement, and optimize data pipelines using Databricks, PySpark, and...