Data Engineer

4 weeks ago


London Area, United Kingdom Distributed Full time
About the Role

We're seeking a highly skilled Data Engineer to join our team at Distributed, a software development company building the world's Elastic Workforce. As a key partner in the telecoms industry, we're working on a cutting-edge SIEM project to enhance our security maturity and comply with the Telecommunications Security Act.

As a Data Engineer, you'll work closely with our high-performing team of engineers to deliver cutting-edge security tools and solutions. Your responsibilities will include log source onboarding, technical leadership, and developing custom Elastic ingest pipelines to effectively parse log data from various sources.

Key Responsibilities
  • Team Collaboration: Work within a high-performing team of engineers to deliver cutting-edge security tools and solutions.
  • Log Source Onboarding: Take the lead on log source onboarding for Network SIEM, managing the integration of critical data sources.
  • Technical Leadership: Provide expert guidance and liaise with log source platform owners and ASGs to ensure smooth and efficient integration.
  • Elastic Ingest Pipelines: Develop custom Elastic ingest pipelines to effectively parse log data from a variety of sources.
  • Cross-Functional Collaboration: Work closely with the wider SIEM team to ensure successful log source ingestion and ongoing functionality.
  • Design Involvement: Contribute to SIEM design, particularly in areas that enhance log source ingestion and data management.
  • Timely Delivery: Ensure all tasks are completed on time and within budget, maintaining high standards throughout.
  • Documentation: Keep documentation up-to-date, reflecting any changes or improvements in SIEM processes.
  • Continuous Improvement: Actively drive continuous improvement, refining processes and methodologies to enhance team performance.
About You

We're looking for passionate technologists who enjoy working in collaborative agile teams. You'll need to be a clear, concise, and engaging communicator with people on your team. We enjoy the big picture and the detail; we want people who excel at both.

Log Source Data Onboarding: Experienced in onboarding and managing data from various log sources.

ETL Expertise: Strong skills in data extraction, transformation, and loading (ETL) processes to manage and optimize data pipelines.

Log Augmentation: Proficient in enhancing and enriching log data for better analysis and insight.

Teamwork and Collaboration: Demonstrates excellent teamwork, working effectively with stakeholders and team members.

Technical Tools: Skilled in Elasticsearch, Kibana, Beats/Elastic Agent, and data collection/filtering through Logstash.

Kafka: Solid understanding of Kafka concepts for managing real-time data streams.

Regular Expressions: Knowledge of regular expressions for efficient data parsing and manipulation.

Additionally, any experience in the below would be welcomed:

  • Experience in SIEM or similar cyber security tool development.
  • Agile Delivery: Familiarity with agile methodologies and project delivery.
  • Elastic Fleet: Experience with Elastic Fleet for centralized agent management.
  • Elastic Common Schema (ECS): Knowledge of ECS for standardizing data.
  • Telecoms Security Act (TSA): Understanding of the Telecoms Security Act and its implications for security compliance.


  • London Area, United Kingdom she does data. Full time

    Job Title: Strategy & Data Consultant EngineerWe are seeking a highly skilled Data Consultant Engineer to join our team at She Does Data. As a key member of our team, you will play a crucial role in helping our clients achieve their business goals through data-driven insights.Key Responsibilities:Develop and implement data strategies to drive business growth...


  • London Area, United Kingdom she does data. Full time

    Job Title: Strategy & Data Consultant EngineerWe are seeking a highly skilled Data Consultant Engineer to join our team at She Does Data. As a key member of our team, you will play a crucial role in helping our clients achieve their business goals through data-driven insights.Key Responsibilities:Develop and implement data strategies to drive business growth...

  • Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    Solutions Engineer (Data Engineering and / or Data Warehousing)About the RoleWe are seeking a highly skilled Solutions Engineer to join our team. As a Solutions Engineer, you will work closely with clients to demonstrate how our Data Intelligence Platform can address complex data challenges.Key ResponsibilitiesDesign and implement data engineering solutions...

  • Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    Solutions Engineer (Data Engineering and / or Data Warehousing)About the RoleWe are seeking a highly skilled Solutions Engineer to join our team. As a Solutions Engineer, you will work closely with clients to demonstrate how our Data Intelligence Platform can address complex data challenges.Key ResponsibilitiesDesign and implement data engineering solutions...

  • Data Engineer

    4 weeks ago


    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...

  • Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the delivery of data transformation during an exciting time within the company.You will collaborate with the wider data teams to build and...

  • Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the delivery of data transformation during an exciting time within the company.You will collaborate with the wider data teams to build and...

  • Data Engineer

    4 weeks ago


    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    4 weeks ago


    London, United Kingdom Data Idols Full time €400 - €500

    Data Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...

  • Data Engineer

    4 weeks ago


    London, United Kingdom Data Idols Full time €400 - €500

    Data Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...

  • Data Engineer

    3 weeks ago


    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    4 weeks ago


    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    4 weeks ago


    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    Exciting Opportunity for a Full-Stack Data EngineerData Idols is working with a leading national software company that helps the public sector build better data solutions. We are seeking a skilled Full-Stack Data Engineer to join our team for an initial three months to assist in modernising data pipelines, data standards, and data reports.The OpportunityAs a...

  • Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    Exciting Opportunity for a Full-Stack Data EngineerData Idols is working with a leading national software company that helps the public sector build better data solutions. We are seeking a skilled Full-Stack Data Engineer to join our team for an initial three months to assist in modernising data pipelines, data standards, and data reports.The OpportunityAs a...

  • Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    Solution Architect for Data Engineering and Data WarehousingAt Databricks, we're on a mission to simplify data science and analytics for our customers. As a Solution Architect, you'll work closely with clients to demonstrate how our Data Intelligence Platform can address complex data challenges.Key ResponsibilitiesDesign and implement data engineering...


  • London Area, United Kingdom she does data. Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer Consultant to join our team at Mirai. As a key member of our consultancy, you will play a crucial role in helping our clients drive business growth through data-driven insights.Key ResponsibilitiesDevelop and implement data pipelines in cloud platforms, leveraging tools like dbt, SQL, Python, and...


  • London Area, United Kingdom she does data. Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer Consultant to join our team at Mirai. As a key member of our consultancy, you will play a crucial role in helping our clients drive business growth through data-driven insights.Key ResponsibilitiesDevelop and implement data pipelines in cloud platforms, leveraging tools like dbt, SQL, Python, and...

  • Data Engineer

    7 days ago


    London, Greater London, United Kingdom Data Idols Full time £400 - £500

    Role OverviewData Idols is seeking a skilled Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company.Key ResponsibilitiesImprove data structures, pipelines and reportingCollaborate with the CTO to review reports and implement necessary changes or improvementsWhat You'll GainUp to £500 a...

  • Data Engineer

    1 month ago


    London, Greater London, United Kingdom Data Privacy Full time

    Unlock Your Potential as a Data EngineerAt Houseful, we're on a mission to empower individuals to make informed decisions about their homes. As a leading property brand, we're committed to leveraging data and technology to drive the property market forward.About the RoleWe're seeking an experienced Data Engineer to join our team. As a key member of our data...