Lead Data Engineer
4 weeks ago
Lead Data Engineer:
We need some strong Data engineer profiles… they need good experience with
Pyspark, Python, SQL, ADF and preferably Databricks experience
Job description:
- Building new data pipelines and optimizing data flows using the Azure cloud stack.
- Building data products from scratch.
- Support Business Analysts and Data Architects with discovery and best practices.
- Self-directed and comfortable supporting the data needs of multiple teams, systems and products.
What’s required ?
- Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
- Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark.
- Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
- Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics
Experience with Object-oriented/ object function scripting languages: Python preferred
-
Lead Data Engineer
3 weeks ago
Leeds, Leeds, United Kingdom Sky Betting and Gaming Full timeWhat you'll doAn opportunity has arisen for a Lead Data Engineer to join one of our most exciting areas - the Data tribe. If you thrive in a fast paced, collaborative environment and share our passion for working with the newest technology across Data, then we're looking to hear from youIdeally, you will have existing experience in either software or data...
-
Lead Data Engineer
1 week ago
Leeds, United Kingdom HCLTech Full timeLead Data Engineer:Make your application after reading the following skill and qualification requirements for this position.We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experienceJob description:Building new data pipelines and optimizing data flows using the Azure cloud...
-
Lead Data Engineer
4 weeks ago
Leeds, United Kingdom HCLTech Full timeLead Data Engineer:We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experience Job description:Building new data pipelines and optimizing data flows using the Azure cloud stack.Building data products from scratch.Support Business Analysts and Data Architects with discovery and...
-
Lead Data Engineer
1 day ago
Leeds, United Kingdom HCLTech Full timeLead Data Engineer:Make your application after reading the following skill and qualification requirements for this position.We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experienceJob description:Building new data pipelines and optimizing data flows using the Azure cloud...
-
Lead Data Engineer
3 weeks ago
Leeds, United Kingdom HCLTech Full timeLead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with...
-
Lead Data Engineer
6 hours ago
Leeds, United Kingdom HCLTech Full timeJob Description Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data...
-
Lead Engineer/Data Engineer
6 hours ago
Leeds, United Kingdom HCLTech Full timeJob Description Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and...
-
Process Engineer Manufacturing
4 weeks ago
Leeds, United Kingdom Abs Data Full timeProcess Engineer – Manufacturing Saint-Gobain Highly competitive pay/package and professional development program. Are you a Process Engineer who is passionate about delivering manufacturing Improvement projects while ensuring optimum manufacturing performance is maintained? The British Gypsum manufacturing facility in Sherburn in Elmet is part of...
-
Lead Engineer/Data Engineer
6 days ago
Leeds, United Kingdom Novuna Consumer Finance Full timeAre you passionate about data? This role is Hybrid and will require 1 day in the office per week, applicants must be in commutable distance from either our Newbury or Staines sites. At Novuna, we care about building a better tomorrow. With a focus on sustainability, and a passion for phenomenal customer experiences, we provide consumers and businesses with...
-
Principal Data Platform Engineer
4 weeks ago
Leeds, United Kingdom Scot Lewis Associates Full timePrincipal Engineer - Data and Platform Engineering - £90-£110k Are you a forward-thinking tech leader with a passion for data and cloud solutions? My client is seeking a Principal Engineer with expertise in Databricks, AWS, and GCP to join their team and drive innovation in data processes and cloud infrastructure. As a Principal Engineer, you'll lead...
-
Data Engineer
2 weeks ago
Leeds, United Kingdom G.Digital Full timeAWS Data Engineer | £50-60k | Fintech | Hybrid Leeds Want to work for a business that uses Data to create predictions that shape the future of fintech decision making? If so, AWS Data Engineers this one is for you... About the business
-
Master Data Engineer
7 days ago
Leeds, United Kingdom Page Group Full timeTo maintain Engineering documentation for the Manufacturing Department. Carry out projects within the Manufacturing Department to improve efficiency and reduce costs **Client Details** One of the world's leading engineering companies which helps customers to use electrical power effectively and to increase industrial productivity in a sustainable way;...
-
Lead Software Engineer
3 weeks ago
Leeds, United Kingdom staq Full timeExciting Opportunity for Lead Sim Developer! We've teamed up with an innovative company in the simulation and training industry! Our client's mission is to transform the way people are trained by harnessing human performance data in simulation and training and they're looking for a Lead Sim Developer to work on their Simulator. What Will You Do? Lead and...
-
Head of Data Engineering and Governance
3 weeks ago
Leeds, United Kingdom Investigo Full timeGroup Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data...
-
Head of Data Engineering and Governance
2 weeks ago
Leeds, United Kingdom Investigo Full timeGroup Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data Engineering...
-
Head of Data Engineering and Governance
2 weeks ago
Leeds, United Kingdom Investigo Full timeGroup Head of Data Engineering & GovernanceAre you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team.The Role As the Group Head of Data Engineering &...
-
Data Engineer
3 weeks ago
Leeds, United Kingdom Asda Stores Ltd Full timeJob Title Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Graduate (Fixed Term) Hours per Week 37.5 Salary Competitive salary Category Data Science Closing Date 26 May 2024 Are you a recent graduate in Data or similar that wants to kick start their career? Look no...
-
Data Engineer
2 weeks ago
Leeds, United Kingdom ASDA Full timeJob Title Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Graduate (Fixed Term) Hours per Week 37.5 Salary Competitive salary Category Data Science Closing Date 26 May 2024 Are you a recent graduate in Data or similar that wants to kick start their career? Look no further as have an exciting opportunity to join...
-
AWS Data Engineer
3 days ago
Leeds, United Kingdom Corecom Consulting Full timeI’m working with an industry leading brand that are currently undertaking a large scale data transformation across the whole group. You will be joining an fast paced Engineering team that need support from an analytical perspective. Your responsibilities will include extracting data from multiple sources into the AWS database and helping to transform the...
-
Head of Data Engineering and Governance
2 weeks ago
Leeds, United Kingdom Investigo Full timeGroup Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data...