Senior Data Infrastructure Engineer

1 month ago

London, United Kingdom Workato Inc Full time

Responsibilities

As a Senior Data Infrastructure Engineer you will be responsible for deploying, scaling and maintenance of services at the core of Workato Data Platform such as analytical data storages, real time ingestion services, data lakes, orchestration tools. You will closely work with Data Engineers, and Developers as a part of a small, flexible team and will have a direct impact on the process of modernisation and maturation of the platform including infrastructure architecture decisions.

Workato Data Platform is based on the industry leading technologies such as Snowflake Data Warehouse, Clickhouse Database, Airflow, Apache Kafka and AWS (RDS, Lambda, Fargate, etc), Prometheus, VictoriaMetrics and Workato SAAS solution itself for collecting data from third party business supporting services.We are currently working on upgrading the platform to meet new requirements of rapidly growing business such as:

  • Increase the confidence in analytical data.

  • Make a clearest possible vision of the user journey.

  • Minimize the gap between data emitting and data availability for analytical purposes.

  • Support for a fast growing amount of data.

We plan to achieve this by adopting some additional leading edge technologies such as DBT, Trino, Kafka Streams, Kafka Connect and DataHub unified metadata management platform. Thus, you will work with the technologies that are relevant in the industry and will have challenging tasks.

Requirements Qualifications / Experience / Technical Skills

  • 8+ years of trackable work experience with deploying and supporting data-intensive services.

  • Production experience with building deployments of services commonly used as a part of data platform stack such as Kafka, Debezium, Airflow, Trino/Presto, Spark, Flink, Clickhouse, S3, Firehose, Kinesis, Snowflake, Big Query, Red Shift.

  • Experience monitoring, logging, and analyzing service health. Ability to troubleshoot common bottlenecks of data intensive applications.

  • Experience with managing complex infrastructure (such as Kubernetes clusters, VPC networking and security policies) using Infrastructure as Code tools (e.g. Terraform or CloudFormation).

  • Experience creating application deployments of Kubernetes-based services using tools like Kustomize, Helm, etc

  • Experience with AWS cloud computing (EC2, RDS, EKS, EMR, Route53, VPCs, Subnets, Route Tables).

  • Basic knowledge of one or more high-level programming languages, such as Python, Go, Java.

  • Experience with a solution cost optimization and capacity planning.

  • Good understanding of Data Privacy and Security (GDPR, CCPA).

Soft Skills / Personal Characteristics

  • Good communication and collaboration skills.

  • Exposure or interest working with Data pipeline technologies.

  • Readiness to work remotely with teams distributed across the world and timezones.

  • Spoken English (at the level enough to pass technical interviews and later work with colleagues)

#J-18808-Ljbffr

  • Senior Engineer, Data Engineering

    1 month ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Senior Engineer, Data Engineering

    1 month ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Senior Engineer, Data Engineering

    4 weeks ago

    London, United Kingdom Data Idols Full time

    Job Description Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...

  • Senior Engineer, Data Engineering

    1 week ago

    London, United Kingdom Data Science Festival Full time €70,000 - €85,000

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...

  • Senior Engineer, Data Engineering

    1 week ago

    London, United Kingdom Data Science Festival Full time €70,000 - €85,000

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...

  • Senior Data Engineer

    2 months ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **Salary: £70,000 - £90,000** **LONDON** This is an extremely technically driven company offering many benefits. They are data-driven and are situated globally, streaming and using data to best help their customer. **THE COMPANY** This global data company is heavily driven by Data and Analytics and is looking for a Senior Data...

  • Senior Data Engineer

    2 days ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **LONDON BASED** **£90,000-100,000 PER ANNUM** This UK-based Fintech are searching for a new Senior Data Engineer to help architect and build a new data platform in AWS. You will also be responsible for liaising with stakeholders and influencing future business decisions. **THE COMPANY** This growing UK-based Fintech company...

  • Senior Data Engineer

    1 month ago

    London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are excited to be working with a well-funded startup who are moving into their scale-up phase. We are working to recruit the first Data Engineer, you will be involved in architecting and building their greenfield data platform. In this excitingand dynamic role, you will be involved from the very beginning, selecting the...

  • Senior Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with a company who has a mission to improve the lives of learners globally, who want to build a more sustainable future everyone can reach their potential in. Do you want to be a part of a change into the sustainable future? **The Opportunity** Within this role as a Senior Data Engineer you will be...

  • Senior Data Engineer

    1 month ago

    London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools,...

  • Senior Data Engineer

    5 days ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **UP TO £85,000 + BENEFITS** **LONDON, CURRENTLY FLEXIBLE / REMOTE / HOMEWORKING** Harnham is partnered with a global travel company, that uses real-time data to bring together relevant information for travelers to make their journey as easy as possible. This is a hands-on role where you will be joining a team of 2, ensuring all...

  • Data Engineer

    1 week ago

    London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...

  • Lead Engineer/Data Engineer

    2 months ago

    London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...

  • Senior Data Engineer

    2 months ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER** **Salary: £50,000 - £75,000** **LONDON** This is an extremely technically driven company offering many benefits. They are data-driven and one of the fastest-growing companies in the world, using data to best help their customer by providing consumer products across the globe. **THE COMPANY** This company is heavily driven by Data and...

  • Senior Infrastructure Engineer

    4 weeks ago

    Greater London, United Kingdom Carrington West Full time

    Senior Infrastructure Engineer Our client is seeking a highly skilled and experienced Senior Infrastructure Design Engineer to join their team in London. The successful candidate will be responsible for leading the design, development, and implementation of complex infrastructure projects. Responsibilities: Lead the design and implementation of complex...

  • Senior Infrastructure Engineer

    4 weeks ago

    Greater London, United Kingdom Carrington West Full time

    Senior Infrastructure Engineer Our client is seeking a highly skilled and experienced Senior Infrastructure Design Engineer to join their team in London. The successful candidate will be responsible for leading the design, development, and implementation of complex infrastructure projects. Responsibilities: Lead the design and implementation of complex...

  • Data Engineer

    2 months ago

    City of London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...