Platform Data Engineer

2 weeks ago


London, United Kingdom Mars Full time

Job Description:What are we looking forEssential Requirements:Proven experience in data platform engineering including building developing and optimising data infrastructure.Proficient primarily in Terraform with strong experience in Infrastructure as Code DevOps pipelines and scripting using Bash and PowerShell.Proficiency in Python.Expertise in Azure cloud services and infrastructure as code (e.g. Azure Resource Manager templates Terraform) and DevOps Pipelines such as Azure DevOps Pipelines or GitHub Actions.Excellent communication skills being able to explain complex platform concepts to both data engineers and business users.Nice to Haves:Bachelors or masters degree in computer science Information Technology or a related fieldExperience with containerisation and orchestration technologies (e.g. Docker Kubernetes).Knowledge of big data technologies and frameworks (e.g. Hadoop Spark).Familiarity with other cloud platforms (e.g. AWS Google Cloud) and PaaS providers (e.g. Snowflake)Knowledge of Inner or Open Source paradigm and way of workingKnowledge of Cloud (Azure) Networking and Security StandardsKey Responsibilities:Data Platform Engineering: Contribute to designing developing and maintaining our data platform and core toolsets on the Azure cloud. Ensure the platform is highly available scalable and performs optimally.Data Tools and Frameworks Development: Contribute to developing and implementing data platform tools and frameworks on Azure to support the organisations data needs. Collaborate with other teams to align data infrastructure with business objectives.Collaborate and support platform users: Work alongside other data teams and business users to help understand their requirements of the platform and support in a third-line capability as and when needed.Infrastructure as Code: Utilise Azure infrastructure as code practices to automate the provisioning and management of data platform resources. Ensure consistency repeatability and efficiency in infrastructure deployment.Technology Evaluation: Stay up-to-date with emerging technologies and industry best practices in data engineering and Azure cloud services. Evaluate and recommend new tools and technologies to enhance the data platforms capabilities and efficiency.#TBDDT Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Employment Type : Full-Time Experience: years Vacancy: 1



  • Greater London, United Kingdom Data Idols Full time

    A forward-thinking data company is seeking a Data Engineer to lead the design of modern cloud data solutions. This role involves mentoring teams, optimizing data platforms, and implementing cutting-edge technologies like Azure Synapse and Microsoft Fabric. Ideal candidates will have experience in cloud data architecture and data governance, with...


  • Greater London, United Kingdom Data Science Festival Full time

    A leading data solutions company is seeking a Data Engineer to join their innovative team in London. As a Lead Data Engineer, you will shape modern cloud data solutions and mentor teams. You’ll work with Azure Synapse and Microsoft Fabric to design optimised data platforms. This role offers a competitive salary, a strong benefits package, and a hybrid...

  • Lead Data Engineer

    4 days ago


    Greater London, United Kingdom Data Idols Full time

    A forward-thinking technology firm is seeking a Lead Data Engineer to join their collaborative team in London. This role involves shaping modern cloud data solutions with Azure Synapse and Microsoft Fabric, while mentoring engineering teams. You'll be responsible for optimizing enterprise data platforms and ensuring compliance across the data environments....


  • London, Greater London, United Kingdom Northern Data Full time £100,000 - £120,000 per year

    Job DescriptionWe're searching for an experienced and visionary Director/Head of Platform Engineering to lead the architecture, development, and scalability of our core platform services across Northern Data Group. You will play a pivotal role in evolving our engineering landscape — driving platform reliability, scalability, and automation across cloud...


  • London, Greater London, United Kingdom Northern Data Group Full time

    Job DescriptionWe're searching for an experienced and visionary Director of Platform Engineering to lead the architecture, development, and scalability of our core platform services across Northern Data Group. You will play a pivotal role in evolving our engineering landscape — driving platform reliability, scalability, and automation across cloud...

  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom Data Idols Full time

    Data EngineerSalary: £80,00 - £85,000Location: Hybrid - London - 1 day per weekWe are currently looking for a Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI function....

  • Data Engineer

    1 week ago


    Greater London, United Kingdom Data Idols Full time

    Base Pay RangeSalary: £80,000 - £85,000Location: Hybrid - London - 1 day per weekOverviewWe are currently looking for a Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI...

  • Data Engineer

    4 days ago


    Greater London, United Kingdom Data Idols Full time

    Base pay range Salary: £80,000 - £85,000 Location: Hybrid - London - 1 day per week We are currently looking for a Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI function....


  • London, United Kingdom NTT DATA Full time £150 - £200

    A leading data solutions provider in Greater London is seeking an experienced Head of Data Engineering to lead a team of 40 Data Engineers.If the following job requirements and experience match your skills, please ensure you apply promptly.This role involves developing strategic data engineering initiatives, overseeing scalable data solutions, and ensuring...


  • London, United Kingdom NTT DATA Full time £150 - £200

    A leading data solutions provider in Greater London is seeking an experienced Head of Data Engineering to lead a team of 40 Data Engineers.If the following job requirements and experience match your skills, please ensure you apply promptly.This role involves developing strategic data engineering initiatives, overseeing scalable data solutions, and ensuring...