Current jobs related to GCP Data Streaming Engineer - Cardiff, Cardiff - Hamilton Barnes
-
Data Engineering Manager
2 days ago
Cardiff, Cardiff, United Kingdom developrec Full timeLead Data Engineer OpportunityWe are seeking an experienced Lead Data Engineer to join our team at developrec. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines and products that support our marketing and advertising strategies.Key Responsibilities:Design and develop data pipelines...
-
Data Engineering Manager
2 days ago
Cardiff, Cardiff, United Kingdom developrec Full timeLead Data Engineer OpportunityWe are seeking an experienced Lead Data Engineer to join our team at developrec. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines and products that support our marketing and advertising strategies.Key Responsibilities:Design and develop data pipelines...
-
Data Engineering Manager
1 day ago
Cardiff, Cardiff, United Kingdom developrec Full timeLead Data Engineer - Wales, Hybrid - £75,000 - £85,000 + BonusOur client, a leading company in the field of data engineering, is seeking an experienced Lead Data Engineer to spearhead their data engineering efforts. In this role, you will oversee the design, development, and maintenance of data pipelines and products that are crucial for optimizing...
-
Data Engineering Manager
1 day ago
Cardiff, Cardiff, United Kingdom developrec Full timeLead Data Engineer - Wales, Hybrid - £75,000 - £85,000 + BonusOur client, a leading company in the field of data engineering, is seeking an experienced Lead Data Engineer to spearhead their data engineering efforts. In this role, you will oversee the design, development, and maintenance of data pipelines and products that are crucial for optimizing...
-
Data Engineering Team Lead
1 week ago
Cardiff, Cardiff, United Kingdom developrec Full timeJob Title: Data Engineering Team LeadJob Summary:We are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of data pipelines and products that support our business strategies.Key Responsibilities:Lead the...
-
Data Engineering Team Lead
2 weeks ago
Cardiff, Cardiff, United Kingdom developrec Full timeJob Title: Data Engineering Team LeadJob Summary:We are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of data pipelines and products that support our business strategies.Key Responsibilities:Lead the...
-
Data Engineering Team Lead
2 weeks ago
Cardiff, Cardiff, United Kingdom developrec Full timeAbout the RoleWe are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of our data pipelines and products.Key ResponsibilitiesLead Data Pipeline Development: Oversee the design and development of data...
-
Data Engineering Team Lead
2 weeks ago
Cardiff, Cardiff, United Kingdom developrec Full timeAbout the RoleWe are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of our data pipelines and products.Key ResponsibilitiesLead Data Pipeline Development: Oversee the design and development of data...
-
Data Engineering Team Lead
2 weeks ago
Cardiff, Cardiff, United Kingdom developrec Full timeAbout the RoleWe are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for overseeing the design, development, and maintenance of our data pipelines and products.Key ResponsibilitiesLead Data Pipeline Development: Design and develop scalable data pipelines...
-
Data Engineering Team Lead
2 weeks ago
Cardiff, Cardiff, United Kingdom developrec Full timeAbout the RoleWe are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for overseeing the design, development, and maintenance of our data pipelines and products.Key ResponsibilitiesLead Data Pipeline Development: Design and develop scalable data pipelines...
-
Data Engineer
3 weeks ago
Cardiff, Cardiff, United Kingdom uSwitch Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at uSwitch. As a Data Engineer, you will play a crucial role in designing, constructing, and managing data pipelines to drive marketing efficiencies and improve ROIs.Key ResponsibilitiesDesign and implement data pipelines using Python, SQL, and Cloud platforms (Azure, AWS,...
-
Data Engineer
7 days ago
Cardiff, Cardiff, United Kingdom uSwitch Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at uSwitch. As a Data Engineer, you will play a crucial role in designing, constructing, and managing data pipelines to drive marketing efficiencies and improve ROIs.Key ResponsibilitiesDesign and implement data pipelines using Python, SQL, and Cloud platforms (Azure, AWS,...
-
Data Engineer
7 days ago
Cardiff, Cardiff, United Kingdom uSwitch Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at uSwitch. As a Data Engineer, you will play a crucial role in designing, constructing, and managing data pipelines to drive marketing efficiencies and improve ROIs.Key ResponsibilitiesDesign and implement data pipelines using Python, SQL, and Cloud platforms (Azure, AWS,...
-
Data Infrastructure Engineer
2 weeks ago
Cardiff, Cardiff, United Kingdom Roku Full timeRoku is seeking a talented Data Infrastructure Engineer to join our growing team! In this role, you will play a crucial part in designing, building, and maintaining the robust data infrastructure that powers Roku's platform. You will collaborate closely with engineers across various teams to ensure seamless data flow and efficient...
-
Data Infrastructure Engineer
4 weeks ago
Cardiff, Cardiff, United Kingdom Roku Full timeRoku is seeking a talented Data Infrastructure Engineer to join our growing team! In this role, you will play a crucial part in designing, building, and maintaining the robust data infrastructure that powers Roku's platform. You will collaborate closely with engineers across various teams to ensure seamless data flow and efficient...
-
Senior Data Engineer
2 weeks ago
Cardiff, Cardiff, United Kingdom developrec Full timeAbout the RoleWe are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of our data pipelines and products.Key ResponsibilitiesLead Data Pipeline Development: Oversee the design and development of data...
-
Senior Data Engineer
2 weeks ago
Cardiff, Cardiff, United Kingdom developrec Full timeAbout the RoleWe are seeking an experienced Data Engineering Team Lead to join our team at developrec. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of our data pipelines and products.Key ResponsibilitiesLead Data Pipeline Development: Oversee the design and development of data...
-
Cardiff, Cardiff, United Kingdom Confused Full timeAbout the RoleConfused.com, a leading online comparison platform, is seeking an experienced AWS Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, constructing, and managing data pipelines that drive marketing efficiencies and improve ROIs.Key ResponsibilitiesDesign and implement data...
-
Cardiff, Cardiff, United Kingdom Confused Full timeAbout the RoleConfused.com, a leading online comparison platform, is seeking an experienced AWS Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, constructing, and managing data pipelines that drive marketing efficiencies and improve ROIs.Key ResponsibilitiesDesign and implement data...
-
Senior Data Engineer
3 weeks ago
Cardiff, Cardiff, United Kingdom Confused Full timeAbout Us We are a dynamic group of online brands dedicated to empowering consumers by providing them with tools and information to make informed decisions about their financial products and services. The Role We are seeking a highly skilled and experienced Data Engineer to join our growing team. In this role, you will play a crucial part in designing,...
GCP Data Streaming Engineer
4 months ago
GCP Data Streaming Engineer - 3 months - Inside IR35 - Hybrid
Are you passionate about leveraging data to drive transformational change? Here's your chance to make a meaningful impact as a GCP Data Streaming Engineer with a renowned global consultancy. Join a market leading consultancy for an exhilarating 3-month contract (with prospects for extension) where you'll play a pivotal role in shaping the future of data streaming solutions.
As our GCP Data Streaming Engineer, you'll be at the forefront of harnessing the power of Google Cloud Platform (GCP) to design, develop, and implement cutting-edge data streaming solutions. Leveraging your expertise in GCP technologies, including Pub/Sub, Dataflow, and BigQuery.
Key Responsibilities:
- Develop Scalable Solutions: Lead the creation of scalable and dependable data streaming solutions on GCP using Apache Kafka and associated technologies.
- Optimize Kafka Setup: Customize Kafka brokers, topics, partitions, and replication to guarantee the highest performance and reliability of data streams.
- Configure Kafka Connectors: Apply your expertise to set up Kafka connectors for batch processing, managing both source and sink connectors to seamlessly integrate data.
- Python and Apache Beam Proficiency: Utilize Python and Apache Beam to craft tailored data processing logic and transformations within pipelines, enabling swift and effective data analysis.
- Ensure Security: Implement SSL/TLS encryption, SASL authentication, and ACL-based authorization to fortify Kafka clusters and communication channels, ensuring data integrity and privacy.
What you will Ideally Bring:
- Hands-On Kafka Configuration: Proven expertise in configuring Kafka connectors for batch processing, optimizing their number for improved performance.
- Python and DataFlow/Apache Beam Proficiency: Skilled in Python and DataFlow/Apache Beam, adept at developing custom data processing logic within pipelines
- Streaming Data Management: Demonstrated ability in handling streaming data, ensuring timely processing and Real Time analysis, employing various techniques like windowing and buffering.
- Secured Cloud Environment Experience: Experienced in deploying Kafka in secure cloud environments, implementing SSL/TLS encryption, SASL authentication, and ACL-based authorization.
- Kafka Configuration and Governance: Proficient in configuring Kafka brokers, managing security, and enforcing schema governance to ensure reliability, scalability, and compliance.
Contract Details:
- Duration: 3 months
- Day Rate: Up to £550 Per Day (All Inclusive)
- Location: Cardiff/Remote
GCP Data Streaming Engineer - 3 months - Inside IR35 - Hybrid
