Principal Data Platforms Engineer

23 hours ago

London, Greater London, United Kingdom Simple Machines Full time
About the Role

At Simple Machines, we're seeking a highly skilled Principal Data Platforms Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, building, and implementing impactful data-driven solutions using a variety of tools and platforms.

Key Responsibilities
  • Architect and implement data-driven solutions that integrate with clients' existing systems, using tools such as Databricks, Snowflake, Google Cloud, and AWS.
  • Develop robust data pipelines using tools like Spark, Flink, Airflow, and Kafka to enable real-time and batch data processing.
  • Optimise and manage a variety of database technologies, including relational and NoSQL databases, ensuring efficient data storage and retrieval.
  • Leverage big data technologies like Spark and Flink to manage large-scale data processing and analysis.
  • Implement and manage cloud-specific data services such as AWS Redshift, S3, Google BigQuery, and Google Cloud Storage.
Requirements
  • Proficient with SQL, Spark, and platforms like Databricks, Snowflake, along with various storage technologies such as S3 (AWS), BigQuery (Google Cloud), Cassandra, Mongo, Neo4J, and HDFS.
  • Experience with pipeline orchestration tools like Glue (AWS), Airflow, dbt, and streaming technologies such as Kafka, Kinesis (AWS), Pub/Sub (Google Cloud), and Event Hubs (Azure).
  • Exposure to, or an understanding of data science/MLOps tools like Sagemaker (AWS), Dataiku, MLflow.
  • Developed and managed large-scale data pipelines and data-intensive applications in a production environment.
What We Offer
  • Competitive salary and benefits package.
  • Up to 5% employer contribution, matching up to a 5% employee contribution, for a total of up to 10%.
  • 4 weeks standard + 1 week additional annual leave over Christmas shut down period, plus public holidays.
  • One additional day off per year, no explanation required
  • £1,250 allowance per year to be used for any food and non-alcoholic beverages during business hours, healthcare, gym memberships, sporting goods and accessories, and any wellness appointments.
  • £1,500 annual budget for training, courses, and conferences, with potential for additional funding.
  • £2,500 annual budget for certifications and related courses.
  • £1,500 for UK team members, plus Apple MacBook Pro laptops and necessary accessories.
  • 10 days per annum, includes coverage for employee's family.
  • Paid time off for antenatal appointments, including classes recommended by health professionals.
  • Three months' continuance of salary at full pay.

  • Principal Data Platform Engineer

    14 hours ago

    London, Greater London, United Kingdom Schroders Full time

    About the RoleWe are seeking a highly skilled Principal Data Platform Engineer to join our Enterprise Data team at Schroders. As a key member of our team, you will be responsible for establishing and integrating innovative technologies into a coherent set of data platform services to serve our data practitioners.Key ResponsibilitiesWork with the team to...

  • Principal Data Platform Engineer

    19 hours ago

    London, Greater London, United Kingdom Schroders Full time

    About the RoleWe are seeking a highly skilled Principal Data Platform Engineer to join our Enterprise Data team at Schroders. As a key member of our team, you will be responsible for establishing and integrating innovative technologies into a coherent set of data platform services to serve our data practitioners.Key ResponsibilitiesWork with the team to...

  • Principal Data Platforms Engineer

    2 weeks ago

    London, Greater London, United Kingdom Simple Machines Full time

    About the RoleWe are seeking a highly skilled Principal Data Platforms Engineer to join our team at Simple Machines. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems that drive business insights and decision-making.Key ResponsibilitiesData Engineering: Develop and...

  • Principal Data Platforms Engineer

    2 weeks ago

    London, Greater London, United Kingdom Simple Machines Full time

    About the RoleWe are seeking a highly skilled Principal Data Platforms Engineer to join our team at Simple Machines. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems that drive business insights and decision-making.Key ResponsibilitiesData Engineering: Develop and...

  • Data Engineering Principal

    6 days ago

    London, Greater London, United Kingdom Metyis AG Full time

    Data Engineering PrincipalWe are seeking a highly experienced Data Engineering Principal to join our Data Engineering Team at Metyis AG in London. As a key member of our team, you will lead the design and execution of data engineering projects, driving the development of operational data platforms and ensuring data quality and governance.Key...

  • Data Engineering Principal

    6 days ago

    London, Greater London, United Kingdom Metyis AG Full time

    Data Engineering PrincipalWe are seeking a highly experienced Data Engineering Principal to join our Data Engineering Team at Metyis AG in London. As a key member of our team, you will lead the design and execution of data engineering projects, driving the development of operational data platforms and ensuring data quality and governance.Key...

  • Principal Data Engineering Manager

    3 weeks ago

    London, Greater London, United Kingdom Primus Connect Full time £90,000

    Job Title: Principal Data EngineerJob Summary:We are seeking an experienced Principal Data Engineer to join our team at Primus Connect. As a Principal Data Engineer, you will be responsible for leading the design, development, and implementation of large-scale data engineering solutions using Databricks, Apache Spark, and Azure Data Platform.Key...

  • Principal Data Engineering Manager

    3 weeks ago

    London, Greater London, United Kingdom Primus Connect Full time £90,000

    Job Title: Principal Data EngineerJob Summary:We are seeking an experienced Principal Data Engineer to join our team at Primus Connect. As a Principal Data Engineer, you will be responsible for leading the design, development, and implementation of large-scale data engineering solutions using Databricks, Apache Spark, and Azure Data Platform.Key...

  • Data Platform Architect

    3 days ago

    London, Greater London, United Kingdom Harnham Full time

    Principal Data EngineerAbout the RoleWe are seeking a highly skilled Principal Data Engineer to join our growing Data and Analytics team. As a key member of our team, you will be responsible for the development and maintenance of our cloud platform in Azure, as well as building new data pipelines using Python and SQL.About the CompanyOur client is a...

  • Data Platform Architect

    3 days ago

    London, Greater London, United Kingdom Harnham Full time

    Principal Data EngineerAbout the RoleWe are seeking a highly skilled Principal Data Engineer to join our growing Data and Analytics team. As a key member of our team, you will be responsible for the development and maintenance of our cloud platform in Azure, as well as building new data pipelines using Python and SQL.About the CompanyOur client is a...

  • Data Platform Architect

    16 hours ago

    London, Greater London, United Kingdom Harnham Full time

    PRINCIPAL DATA ENGINEERLEADING THE WAY IN CLOUD PLATFORM DEVELOPMENT£90,000-100,000 PER ANNUMThis fast-growing international company is seeking a Principal Data Engineer to join their growing Data and Analytics team. As a key member of the team, you will take responsibility for the direction and development of the internal data platform, working closely...

  • Data Platform Architect

    20 hours ago

    London, Greater London, United Kingdom Harnham Full time

    PRINCIPAL DATA ENGINEERLEADING THE WAY IN CLOUD PLATFORM DEVELOPMENT£90,000-100,000 PER ANNUMThis fast-growing international company is seeking a Principal Data Engineer to join their growing Data and Analytics team. As a key member of the team, you will take responsibility for the direction and development of the internal data platform, working closely...

  • Data Platform Architect

    3 days ago

    London, Greater London, United Kingdom Harnham Full time £90,000 - £100,000

    Principal Data EngineerThis retailer is seeking a Principal Data Engineer to lead the development of their cloud platform in Azure.You will be responsible for building new data pipelines using Python and SQL, and maintaining existing ones. The ideal candidate will have strong experience in building data pipelines using Python and a commercial understanding...

  • Data Platform Architect

    3 days ago

    London, Greater London, United Kingdom Harnham Full time £90,000 - £100,000

    Principal Data EngineerThis retailer is seeking a Principal Data Engineer to lead the development of their cloud platform in Azure.You will be responsible for building new data pipelines using Python and SQL, and maintaining existing ones. The ideal candidate will have strong experience in building data pipelines using Python and a commercial understanding...

  • Principal Data Engineer

    1 day ago

    London, Greater London, United Kingdom Epam Full time

    About the RoleWe are seeking a highly skilled Principal Data Engineer to join our multi-disciplinary team of engineers, architects, designers, and strategists in London. As a Principal Data Engineer, you will be responsible for leading and mentoring a team of Azure data engineers, driving technical execution, and collaborating with cross-functional teams to...

  • Principal Data Engineer

    22 hours ago

    London, Greater London, United Kingdom Epam Full time

    About the RoleWe are seeking a highly skilled Principal Data Engineer to join our multi-disciplinary team of engineers, architects, designers, and strategists in London. As a Principal Data Engineer, you will be responsible for leading and mentoring a team of Azure data engineers, driving technical execution, and collaborating with cross-functional teams to...

  • Data Engineer

    2 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Staff Data Engineer About the Role Harnham - Data & Analytics Recruitment is seeking a highly skilled Staff Data Engineer to join our client's expanding data team. As a Staff Data Engineer, you will be responsible for building and maintaining the company's AWS platform, as well as implementing data pipelines using Python. Key Responsibilities Design and...

  • Data Engineer

    2 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Staff Data Engineer About the Role Harnham - Data & Analytics Recruitment is seeking a highly skilled Staff Data Engineer to join our client's expanding data team. As a Staff Data Engineer, you will be responsible for building and maintaining the company's AWS platform, as well as implementing data pipelines using Python. Key Responsibilities Design and...

  • Principal Data Engineering Consultant

    1 week ago

    London, Greater London, United Kingdom Primus Connect Full time £90,000

    ### Job Title: Principal Data Engineer ### Job Description #### About the Role Primus Connect is partnering with a fast-growing data consultancy to source an exceptional Principal Data Engineering Consultant on an exclusive basis. This opportunity is ideal for a seasoned professional with expertise in Azure Data Platform and technical leadership...

  • Principal Data Engineering Consultant

    1 week ago

    London, Greater London, United Kingdom Primus Connect Full time £90,000

    ### Job Title: Principal Data Engineer ### Job Description #### About the Role Primus Connect is partnering with a fast-growing data consultancy to source an exceptional Principal Data Engineering Consultant on an exclusive basis. This opportunity is ideal for a seasoned professional with expertise in Azure Data Platform and technical leadership...