Lead Data Engineer
4 weeks ago
Lead Data Engineer:
We need some strong Data engineer profiles… they need good experience with
Pyspark, Python, SQL, ADF and preferably Databricks experience
Job description:
- Building new data pipelines and optimizing data flows using the Azure cloud stack.
- Building data products from scratch.
- Support Business Analysts and Data Architects with discovery and best practices.
- Self-directed and comfortable supporting the data needs of multiple teams, systems and products.
What’s required ?
- Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
- Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark.
- Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
- Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics
Experience with Object-oriented/ object function scripting languages: Python preferred
-
Lead Data Engineer
3 weeks ago
Leeds, Leeds, United Kingdom Sky Betting and Gaming Full timeWhat you'll doAn opportunity has arisen for a Lead Data Engineer to join one of our most exciting areas - the Data tribe. If you thrive in a fast paced, collaborative environment and share our passion for working with the newest technology across Data, then we're looking to hear from youIdeally, you will have existing experience in either software or data...
-
Lead data engineer
1 day ago
Leeds, United Kingdom Hunter Bond Full timeLead Data Engineer Hyper Scaling ML Startup Location: London/Hybrid My client is seeking a Lead Data Engineer to own the delivery of scalable data pipelines that are critical to the entire firm's infrastructure. Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides itself on working with the most cutting-edge...
-
Lead Data Engineer
3 weeks ago
Leeds, United Kingdom HCLTech Full timeLead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with...
-
Lead Data Engineer
4 weeks ago
Leeds, United Kingdom HCLTech Full timeLead Data Engineer:We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experience Job description:Building new data pipelines and optimizing data flows using the Azure cloud stack.Building data products from scratch.Support Business Analysts and Data Architects with discovery and...
-
Lead Data Engineer
2 weeks ago
Leeds, United Kingdom HCLTech Full timeLead Data Engineer:Make your application after reading the following skill and qualification requirements for this position.We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experienceJob description:Building new data pipelines and optimizing data flows using the Azure cloud...
-
Lead Data Engineer
5 days ago
Leeds, United Kingdom HCLTech Full timeLead Data Engineer:Make your application after reading the following skill and qualification requirements for this position.We need some strong Data engineer profiles… they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experienceJob description:Building new data pipelines and optimizing data flows using the Azure cloud...
-
Lead Data Engineer
4 days ago
Leeds, United Kingdom HCLTech Full timeJob Description Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data...
-
Lead Engineer/Data Engineer
4 days ago
Leeds, United Kingdom HCLTech Full timeJob Description Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and...
-
Process Engineer Manufacturing
1 month ago
Leeds, United Kingdom Abs Data Full timeProcess Engineer – Manufacturing Saint-Gobain Highly competitive pay/package and professional development program. Are you a Process Engineer who is passionate about delivering manufacturing Improvement projects while ensuring optimum manufacturing performance is maintained? The British Gypsum manufacturing facility in Sherburn in Elmet is part of...
-
Lead Data Engineer
36 minutes ago
Leeds, United Kingdom Reed Remote Work Freelance Full timeRole: Lead Data EngineerLocation: Leeds - 2 days per week onsite / 3 days WFHStart: ASAPDuration: 6-12 monthsRequirements: SnowflakeDBT / AirflowAzurePowerBI / DaxTraditional SQLJIRA, Confluence, (GitHub / BitBucket)Azure Data Factory
-
Lead Engineer/Data Engineer
1 week ago
Leeds, United Kingdom Novuna Consumer Finance Full timeAre you passionate about data? This role is Hybrid and will require 1 day in the office per week, applicants must be in commutable distance from either our Newbury or Staines sites. At Novuna, we care about building a better tomorrow. With a focus on sustainability, and a passion for phenomenal customer experiences, we provide consumers and businesses with...
-
Data Manager
4 weeks ago
Leeds, United Kingdom Aspire Data Recruitment Full time**Data Manager - Pricing, Trading & Analytics** **Hybrid, 1 -2 days in the office, Main hubs are Cardiff, Leeds, Chester, London, Bristol or Edinburgh** **To £60,000 (dol)+ flex, bonus (to 30%), pension (to 15%), healthcare, shares etc** The Homes Pricing, Trading & Analytics team is responsible for the management and pricing of over £70bn of mortgages...
-
Principal Data Platform Engineer
1 month ago
Leeds, United Kingdom Scot Lewis Associates Full timePrincipal Engineer - Data and Platform Engineering - £90-£110k Are you a forward-thinking tech leader with a passion for data and cloud solutions? My client is seeking a Principal Engineer with expertise in Databricks, AWS, and GCP to join their team and drive innovation in data processes and cloud infrastructure. As a Principal Engineer, you'll lead...
-
Data Engineer
3 weeks ago
Leeds, United Kingdom G.Digital Full timeAWS Data Engineer | £50-60k | Fintech | Hybrid Leeds Want to work for a business that uses Data to create predictions that shape the future of fintech decision making? If so, AWS Data Engineers this one is for you... About the business
-
Lead Reliability Engineer
2 days ago
Leeds, United Kingdom Client 1 Full timeLead Reliability EngineerLeeds - Hybrid work available.£70,000 - £80,000 + Company Car + Generous Pension + Technical incentive scheme + Excellent progression routeAre you a Lead Engineer looking for an exciting role with one of the UKs leading Electrical Distribution company?On offer is the opportunity to develop your career through excellent...
-
Lead Software Engineer
3 weeks ago
Leeds, United Kingdom staq Full timeExciting Opportunity for Lead Sim Developer! We've teamed up with an innovative company in the simulation and training industry! Our client's mission is to transform the way people are trained by harnessing human performance data in simulation and training and they're looking for a Lead Sim Developer to work on their Simulator. What Will You Do? Lead and...
-
Head of Data Engineering and Governance
3 weeks ago
Leeds, United Kingdom Investigo Full timeGroup Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data...
-
Head of Data Engineering and Governance
2 weeks ago
Leeds, United Kingdom Investigo Full timeGroup Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data Engineering...
-
Head of Data Engineering and Governance
3 weeks ago
Leeds, United Kingdom Investigo Full timeGroup Head of Data Engineering & GovernanceAre you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team.The Role As the Group Head of Data Engineering &...
-
Data Engineer
2 weeks ago
Leeds, United Kingdom ASDA Full timeJob Title Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Graduate (Fixed Term) Hours per Week 37.5 Salary Competitive salary Category Data Science Closing Date 26 May 2024 Are you a recent graduate in Data or similar that wants to kick start their career? Look no further as have an exciting opportunity to join...