Data Engineer

6 months ago

London, United Kingdom Prevail Full time

We are looking for a Data Engineer to establish our internal data engineering capability and play a key role in designing and developing the data infrastructure and systems, ensuring that our data pipelines are reliable, scalable, and efficient.

Reporting into the Head of Data Strategy and Services, you will be responsible for designing data infrastructure to support modelling and data analytics, with strong competence in Python, and work with stakeholders to understand their data needs and help design data solutions.

The Technology team within Prevail underpins all of our mission focused teams. No two days are the same and the real world problems we seek to solve are complicated. You will get the opportunity to interact with a wide range of datasets and support both the wider tech team and mission teams turning this data into insights to drive our customers decision making. The team structure is flat with a network centric approach to leadership. A small team, we rely on strong communication and the ability to mutually support each other whilst working at pace.

Responsibilities:

These are the key things that you are responsible for delivering within your role. There will be activities and tasks in addition to this list that are expected from you but the majority of your time will be:

  • Receiving large datasets and transforming them to enable our mission teams to rapidly exploit the data.
  • Identifying improvements to our current data processes and implementing solutions.
  • Implementing data flows to connect operational systems, data for analytics, and business intelligence systems
  • Creation and development of data pipelines
  • Documenting source-to-target mappings
  • Re-engineering manual data flows to enable scaling and repeatable use
  • Support the build of data streaming systems
  • Build and maintain ETL scripts and pipelines and code to ensure the ETL process performs optimally and ensures data is accurate and easy to use
  • Develop business intelligence reports that can be used for multiple audiences
  • Build accessible data for analysis
  • Automate data processing tasks and workflows
  • Collaborate with cross functional teams to advocate for high-quality data solutions

Requirements

You:

You will have previous proven experience:

  • Building, modelling, and maintaining data pipelines
  • Using a range of Amazon Web Service products and technologies such as EC2, S3, Athena, Glue, and Redshift
  • Designing data infrastructure to support modelling and data analytics
  • As an AWS Solutions Architect or Lead, or a similar role
  • Strong Python experience or experience with other modern complied languages e.g. Go or Rust
  • Data warehousing – building operation ETL data pipelines across several sources, and constructing relation and dimensional data models
  • If you have previous exposure to geospatial data, that would be advantageous but is not a requirement for the position.
  • Excellent communication and collaboration skills

Us:

Prevail Partners delivers strategic advice, intelligence, specialist capabilities and managed services to clients ranging from governments and multinational corporations to non-governmental organisations. These services are delivered predominantly across Europe, the Middle East and Africa.

Benefits

Competitive salary, salary sacrifice pension, access to onsite gym facilities, enhanced leave polices, and private healthcare after two years at Prevail.

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time €400 - €500

    Data Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time €400 - €500

    Data Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    1 month ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    1 month ago

    London, Greater London, United Kingdom Data Idols Full time £400 - £500

    Role OverviewData Idols is seeking a skilled Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company.Key ResponsibilitiesImprove data structures, pipelines and reportingCollaborate with the CTO to review reports and implement necessary changes or improvementsWhat You'll GainUp to £500 a...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time €400 - €500

    Data Engineer Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. As a Full-stack Engineer,...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time €400 - €500

    Data Engineer Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. As a Full-stack Engineer,...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. As a Full-stack Engineer,...

  • Senior Engineer, Data Engineering

    3 months ago

    London, United Kingdom Data Idols Full time €75,000 - €95,000

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...

  • Senior Engineer, Data Engineering

    3 months ago

    London, United Kingdom Data Idols Full time €75,000 - €95,000

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time €90,000 - €110,000

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time €90,000 - €110,000

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Data Engineering Manager

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £90,000 - £95,000

    The OpportunityData Idols is seeking a Data Engineering Manager to support the delivery of data transformation during an exciting time within the company. This individual will work with the teams to implement data strategy and deliver value throughout the company.The ideal candidate will have extensive experience in managing teams, stakeholder management,...

  • Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...

  • Data Systems Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    About the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...