Data Engineer

2 days ago


Glasgow, Glasgow City, United Kingdom eTeam Full time

Role: Data Engineer

Location: Glasgow

Working Mode: Hybrid (Weekly 2 days Onsite 3 days remote)

Contract Type: Inside IR35

Duration: 12 months

Rate: GBP 375 per day Inside IR35

Role Responsibilities

You will be responsible for:

    • Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks
    • Developing and deploying ETL jobs that extract data from various sources, transforming it to meet business needs.
    • Taking ownership of the end-to-end engineering life cycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency.
    • Creating and manage data pipelines, ensuring proper error handling, monitoring and performance optimizations
    • Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives.
    • Conducting code reviews, provide constructive feedback, and enforce coding standards to maintain a high quality.
    • Developing and maintain tooling and automation scripts to streamline repetitive tasks.
    • Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes
    • Utilizing REST APIs and other integration techniques to connect various data sources
    • Maintaining documentation, including data flow diagrams, technical specifications, and processes.

You have:

    • Proficiency in Python programming, including experience in writing efficient and maintainable code.
    • Hands-on experience with cloud services, especially DataBricks, for building and managing scalable data pipelines
    • Proficiency in working with Snowflake or similar cloud-based data warehousing solutions
    • Solid understanding of ETL principles, data modelling, data warehousing concepts, and data integration best practices
    • Familiarity with agile methodologies and the ability to work collaboratively in a fast-paced, dynamic environment.
    • Experience with code versioning tools (eg, Git)
    • Meticulous attention to detail and a passion for problem solving
    • Knowledge of Linux operating systems
    • Familiarity with REST APIs and integration techniques

You might also have:

    • Familiarity with data visualization tools and libraries (eg, Power BI)
    • Background in database administration or performance tuning
    • Familiarity with data orchestration tools, such as Apache Airflow
    • Previous exposure to big data technologies (eg, Hadoop, Spark) for large data processing

  • Data Engineer

    1 day ago


    Glasgow, Glasgow City, United Kingdom Infected Blood Compensation Authority Full time

    LocationGlasgow or Newcastle-upon-TyneAbout the CompanyAre you a highly skilled Data Engineer (SEO) ready to combine your technical leadership with a meaningful mission? The Infected Blood Compensation Authority (IBCA) is a new arm's-length body set up, at unprecedented pace, to administer compensation to people whose lives have been impacted by the infected...

  • Data Engineer

    1 week ago


    Glasgow, Glasgow City, United Kingdom Meraki Talent Full time £50,000 - £60,000 per year

    Data Engineer (PowerBI & Python) - Glasgow (Hybrid, 50% of month in the office) - £50k - £60kMeraki Talent's global financial services client is actively looking for an experienced Data Engineer with particular prowess in PowerBI and Python, to join their growing global team. This person will be the first individual on site in Scotland, but form part of an...

  • Data Engineer

    5 days ago


    Glasgow, Glasgow City, United Kingdom GIOS Technology Full time

    I am hiring forData Engineer - (ETL/Python/DataBricks/Snowflake/Rest API/Banking/Fintech)Location:Glasgow, Hybrid (60 percent Remote, 40 percent Onsite)Job DescriptionWe are hiring a Data Engineer to join cross functional agile teams and support the design and delivery of scalable data solutions. The role involves close collaboration with development squads,...

  • Data Engineer

    2 weeks ago


    Glasgow, Glasgow City, United Kingdom Bounteous Full time £60,000 - £120,000 per year

    Senior Data Architect/EngineerLocation: Glasgow, UK or Anywhere in UKExperience: Minimum of 5 - 7 years of experienceSnowflake and/or databricks is must - hands on experienceThis role will be key to helping our divisional leadership to making informed, data-driven decisions by developing a sophisticated, scalable and explainable decision model to aid...

  • Senior Data Engineer

    2 weeks ago


    Glasgow, Glasgow City, United Kingdom Alphayotta Full time

    We are seeking experiencedSenior Data Engineer (with Power BI expertise) at GlasgowPlease Note: No VISA Sponsorship.Senior Data Engineer (with Power BI expertise)Location: GlasgowDuration: 8 MonthsHybrid work – 2 to 3 days a week onsite mandatory(Eligibility : Should be eligible for SC Clearance)Senior Data Engineer (with Power BI expertise)Lead design,...

  • Data Engineer

    6 days ago


    Glasgow, Glasgow City, United Kingdom Barclays Full time

    Job DescriptionPurpose of the roleTo build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. AccountabilitiesBuild and maintenance of data architectures pipelines that enable the transfer and processing of durable,...

  • Senior Data Engineer

    2 weeks ago


    Glasgow, Glasgow City, United Kingdom RES Full time £60,000 - £120,000 per year

    Do you want to work to make Power for Good?We're the world's largest independent renewable energy company. We're driven by a simple yet powerful vision: to create a future where everyone has access to affordable, zero carbon energy.We know that achieving our ambitions would be impossible without our people. Because we're tackling some of the world's toughest...

  • Senior Data Engineer

    2 weeks ago


    Glasgow, Glasgow City, United Kingdom Scott Logic Full time £60,000 - £120,000 per year

    We work with some of the UK's biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice.Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for...

  • AWS Data Engineer

    7 days ago


    Glasgow, Glasgow City, United Kingdom GIOS Technology Full time

    I am hiring for AWS Data Engineer - UI DevelopmentLocation: Glasgow - Hybrid / 2-3 days Per week in OfficeStrong hands-on experience delivering production-grade data engineering solutions.Proficiency in SQL and programming languages (Python / PySpark strongly preferred).Experience with orchestration tools such as Airflow, AWS Step Functions,...


  • Glasgow, Glasgow City, United Kingdom Head Resourcing Full time £60,000 - £100,000 per year

    Senior Data Engineer - Azure & Databricks LakehouseGlasgow (3/4 days onsite) | Exclusive Role with a Leading UK Consumer BusinessNo sponsorship/ relocation provided sadlyOur incredibly successful client, consumer brand is undertaking a major data modernisation programme-moving away from legacy systems, manual Excel reporting and fragmented data sources into...