Python Data Engineer

1 week ago


London, Greater London, United Kingdom Caspian One Full time
We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund.

The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real Time data streams.


Role:

Python Data EngineerClient:
Leading Hedge FundType of role: contract (6 months)

Location:
London officeRate: up to £1500/day

Key Responsibilities:

Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such as web scrapes, PDF files, and Real Time data infrastructures.

Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility.
Build and maintain Real Time data processing systems capable of handling large volumes of data with minimal latency.
Collaborate with cross-functional teams to gather requirements, define data needs, and provide scalable data solutions.
Continuously evaluate and implement new tools and technologies to enhance data efficiency and quality.

Qualifications:
Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.

Minimum of 7+ years of experience in a data engineering role, with a strong focus on ETL processes, data warehousing, and Real Time data processing.

Proficiency in Python programming; knowledge of C++ is an advantage.
Expertise in SQL and experience with SQL Server and other database technologies.
Experience with cloud services (AWS, Azure, Google Cloud) and understanding of cloud-based data solutions.

Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.

Experience in data modeling, data access, and data storage techniques.
Excellent problem-solving skills and the ability to think algorithmically.

Desirable Skills:
Knowledge of big data technologies (Hadoop, Spark, Kafka) is highly desirable.
Familiarity with data governance and compliance requirements.
  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom Data Idols Full time

    Data Engineer Are you a mid-level Data Engineer skilled in Azure technologies, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their healthcare journey while saving hospitals time, effort, and money This opportunity provides remote...


  • London, Greater London, United Kingdom High 5 Games Full time

    About High 5:Join the leading company in the rapidly growing world of Casino Gaming. High 5 develops games for various platforms and is currently enjoyed by players in numerous countries worldwide. High 5 is dedicated to creating a highly engaging social casino gaming experience, providing an exciting and diverse work environment for its team members to...


  • London, Greater London, United Kingdom Dive Into Python Full time

    Python Engineer, Commodity Markets and Finance We are looking for a motivated Software Engineer To join our talented technology team and work closely with our Commodities desks. You will work in a fast-paced trading environment closely with key business stakeholders to understand issues and provide solutions that make a tangible and critical difference to...


  • London, Greater London, United Kingdom Python Software Foundation Full time

    You will work as part of a close-knit team to continue the development of analysis and control software for TeraView's industrial sensing and metrology solutions. The role encompasses system design from human-machine interface through data flow and analysis to hardware interfacing and control. No telecommuting No Agencies Please A minimum of five years'...


  • London, Greater London, United Kingdom Data Science Festival Full time £70,000 - £85,000

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with different...


  • London, Greater London, United Kingdom High 5 Games Full time

    About High 5: Join the leader of the fastest-growing segment of online entertainment – Casino Gaming. Developing for the land-based, online, mobile, and social markets, High 5 has created hundreds of games that are played in 150 countries on six continents. High 5 is actively building out the most entertaining social casino gaming experience on both web...

  • Lead Data Engineer

    1 week ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer - Residential Property CompanyLocation: London (flexible working available)Salary: CompetitiveWe are a leading residential property company looking to hire a Lead Data Engineer to join our growing data-focused team. You will be responsible for leading a team of data engineers and playing a key role in the development and maintenance of our...


  • London, Greater London, United Kingdom Harnham Full time

    Python Data EngineerSouth West LondonUp to £100,000Are you interested in working on greenfield projects?THE COMPANYA rising global community of dedicated coworkers working in financially responsible institutions share the same goal of becoming the community's top school. Everything we do for our kids, coworkers, and parents has learning at its core. We have...


  • London, Greater London, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Senior Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...

  • gcp data engineer

    1 week ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP DATA ENGINEER, 6-MONTH CONTRACT LONDON (FULLY REMOTE) £600-£700 PER DAY This position as a GCP Engineer allows you to work within a dynamic Telecoms company located in the heart of London. You will be developing a new GCP data environment and migrating data into the new environment. THE COMPANY This Telecoms company has been very well established...


  • London, Greater London, United Kingdom Python Software Foundation Full time

    You will work as part of a close-knit team to continue the development of analysis and control software for TeraView's industrial sensing and metrology solutions. The role encompasses system design from human-machine interface through data flow and analysis to hardware interfacing and control. The ideal candidate will have a strong technical background, a...

  • Lead Data Engineer

    1 week ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer Location: LondonSalary: £100,000 + BenefitsExciting Opportunity in LondonDo you want to work in the media sector for a top company? We are currently seeking a skilled Lead Data Engineer ready for a new challenge and eager to grow in their career.About the CompanyThis innovative media company is data-driven and is seeking a Lead Data...

  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom DATA MART Consulting GmbH Full time

    Your Role: Apollo is establishing a set of truly innovative data services to propel the business to the next level. We are capturing, transforming, and analysing a vast variety of data through a modern data platform to produce fabulously rich insight for our business. You are the enthusiastic, skilful, and creative Data Engineer we need to make this...

  • Aws Data Engineer

    1 week ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    AWS Data Engineer£ a day, Inside IR35.Hybrid role, 2 days a week on-site. London office.6-Month Contract, potential to keep rollingFantastic opportunity to join an oil and gas company is an expanding team. You will join the business as an AWS Data Engineer playing a major role in a migration project that is ongoing, helping push it through to completion....

  • gcp data engineer

    1 week ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP DATA ENGINEER, 6-MONTH CONTRACT LONDON (FULLY REMOTE) £600-£700 PER DAY This position as a GCP Engineer allows you to work within a dynamic Telecoms company located in the heart of London. You will be developing a new GCP data environment and migrating data into the new environment. THE COMPANY This Telecoms company has been very well established...

  • Gcp Data Engineer

    1 week ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP Data Engineer£ a day, Inside IR35.Hybrid role, 2 days a week on-site. London office.6-Month Contract, potential to keep rollingFantastic opportunity to join an energy company is an expanding team. You will join the business as a GCP Data Engineer playing a major role in a migration project that is about to kick-off. This migration is from their legacy...

  • Python Engineer

    1 week ago


    London, Greater London, United Kingdom trgtment Full time

    Role:Senior Python Engineer (Contract)Fully Remote (based in London)Compensation :£550 – £600 (p/d)Work on a data-driven platform managing large amounts of data, constructing ETL pipelines, and leveraging BigQuery.Proficiency in the Python standard library and contemporary Python programming, testing, troubleshooting, and automation approaches.Experience...


  • London, Greater London, United Kingdom Options Group Full time

    Data Engineering Manager – London Our client is a major commodities-focused hedge fund with a global footprint and 2000+ employees. As a Global Data Engineering Manager, you will contribute to building and developing an enterprise data platform and related applications in a complex and demanding trading environment. This is a cutting-edge team of Data...

  • Lead Data Engineer

    1 week ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    LEAD DATA ENGINEERLONDON, CURRENTLY FLEXIBLE / REMOTE / HOMEWORKINGUP TO £100,000 + BENEFITSAs a Lead Data Engineer, you will be inheriting a Snowflake data platform for a successful Ecommerce company that has disrupted the market with their product line. You will be leading a junior squad so will remain hands-on to further develop the platform and team...

  • Python Engineer

    1 week ago


    London, Greater London, United Kingdom Albert Bow Full time £85,000

    Senior Python Engineer | Artificial Intelligence | Hybrid London | up to £85k Albert Bow looking for are looking for experienced Python Engineers (mid to senior) in London to join an innovative and globally recognised company that utilise AI to analyse data within private equity They're on a mission to create the go-to-market for the most reliable...