Senior Engineer, Data Engineering
2 weeks ago
Role: Senior Data Engineer Job Type: Permanent
Location: London (Hybrid)
Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing?
Are you passionate about Azure Cloud and Python?
Are you keen to build your career with a dynamic global IT Consultancy implementing cutting-edge data engineering solutions?
Make a meaningful impact as a Senior Data Engineer
TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.
access to endless learning opportunities.
As a Senior Data Engineer , you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. You will be working with Data Engineers in harnessing the power of Databricks and Synapse to build scalable and efficient data pipelines, data lakes, and analytical solutions.
With expertise in tools like Airflow for orchestration and GitHub for version control, you will champion DevOps practices to ensure seamless collaboration and automation across the data engineering lifecycle. Your proficiency in SQL, PySpark, and Python will be helpful in transforming raw data into valuable insights, while your familiarity with Kafka will enable real-time data processing capabilities.
Lead the design, development, and maintenance of Azure-based data pipelines and analytical solutions using Databricks, Synapse, and other relevant services.
Leverage SQL, PySpark, and Python to perform data transformations, aggregations, and analysis on large datasets.
Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance.
Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand business requirements and deliver impactful data solutions.
Monitor and optimise data pipelines for performance, reliability, and cost-effectiveness, leveraging Azure monitoring and logging services.
Ensure compliance with data governance policies, security standards, and regulatory requirements across all data engineering initiatives.
Stay abreast of industry trends and emerging technologies in cloud computing, big data, and analytics, and evaluate their applicability to our data engineering roadmap.
Mentor and coach team members on technical skills, best practices, and emerging technologies in the data engineering space.
Participate in strategic planning and roadmap development for the data engineering function, aligning with organizational goals and objectives.
experience in Data Engineering, Solution designing and Cloud Computing.
in Azure cloud services, particularly Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage.
programming skills in Python, with experience developing data processing applications using PySpark. Solid understanding of SQL for data manipulation, querying, and optimisation in Azure environments.
with version control systems such as GitHub and DevOps practices for automated deployment and infrastructure management.
of real-time data streaming technologies such as Kafka for building event-driven architectures.
experience with CI/CD pipelines for automated testing, build, and deployment of data engineering solutions.
to work effectively in an agile environment, collaborating with cross-functional teams and adapting to changing priorities.
problem-solving abilities and attention to detail, with a focus on delivering high-quality, scalable data solutions.
or master’s degree in computer science, engineering, or a related field.
with Kafka for building real-time data streaming pipelines and event-driven architectures.
with CI/CD tools such as Azure DevOps or Jenkins for automating the deployment and testing of data engineering solutions.
of agile methodologies such as Scrum or Kanban, and experience working in cross-functional agile teams.
of containerization technologies such as Docker and orchestration tools like Kubernetes for containerized deployments.
with workflow management tools such as Airflow for orchestrating complex data pipelines and ETL processes.
certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem.
Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.
Diversity, Inclusion & Wellbeing
At TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity motto is ‘Inclusion without Exception’.
You’ll find a welcoming culture and many internal volunteering and social networks to join. Our diversity, inclusion and social activities involve 12 employee networks including LGBTQ+ & Allies, mental health, disability & neurodiversity inclusion and many more, as well as health & wellness initiatives and sports events (we even sponsor the London Marathon).
We are open to all and treat applications equally, regardless of ethnicity, disability, gender identity, gender reassignment, age, sexual orientation, or beliefs.
If you are an applicant who needs a reasonable accommodation due to Disability or Neurodiverse Condition to complete an employment application, or during any phase of the hiring process, please contact us at kowsalya.com with the subject line: “Reasonable Accommodation Request”.
Online application 2.
-
Senior Data Engineer
1 month ago
United Kingdom ON Data Staffing Full timeOur client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...
-
Senior Data Engineer
2 months ago
United Kingdom ON Data Staffing Full timeOur client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...
-
Senior Data Engineer
1 month ago
United Kingdom ON Data Staffing Full timeOur client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...
-
Senior Data Engineer
2 months ago
United Kingdom ON Data Staffing Full timeOur client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...
-
Senior Data Engineer
2 months ago
United Kingdom ON Data Staffing Full timeOur client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...
-
Senior Data Engineer
2 months ago
United Kingdom ON Data Staffing Full timeOur client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...
-
Senior Data Engineer
1 month ago
United Kingdom ON Data Staffing Full timeOur client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...
-
Senior Engineering
4 days ago
United Kingdom The Engineer Full time €75,000Head of Future Engineering & International Co-ordination - FCAS Join us in crafting and delivering the Future Combat Air Programme (FCAS) for the RAF in record time! As the Senior Engineering representative leading a multifunctional team of experts, you will hold a significant position within the Programme. Reporting into the Chief Engineer and with...
-
Senior Engineer, Data Engineering
1 month ago
United Kingdom La Fosse Full timeSenior Data Engineer - 6 month FTC London (Hybrid Role) £Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal in driving value for customers through modelling, sourcing, and data transformation. The...
-
Senior Engineer, Data Engineering
1 week ago
United Kingdom Clearwater People Solutions Ltd Full timeOur client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and...
-
Senior Engineer, Data Engineering
3 weeks ago
United Kingdom Clearwater People Solutions Ltd Full timeOur client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and...
-
Senior Engineer, Data Engineering
7 days ago
United Kingdom Better Placed Ltd - A Sunday Times Top 10 Employer in 2023! Full time €100,000Senior Data Engineer – West London - £100,000 Description I am seeking a highly skilled Senior Data Engineer to join an innovative team for one of my clients who specialise in computer software. As a Senior Data Engineer, you will be responsible for the development, implementation, and maintenance of our data infrastructure, ensuring the efficient and...
-
Senior Engineer, Data Engineering
7 days ago
United Kingdom Better Placed Ltd - A Sunday Times Top 10 Employer in 2023! Full time €100,000Senior Data Engineer – West London - £100,000 Description I am seeking a highly skilled Senior Data Engineer to join an innovative team for one of my clients who specialise in computer software. As a Senior Data Engineer, you will be responsible for the development, implementation, and maintenance of our data infrastructure, ensuring the efficient and...
-
Process Engineering
2 months ago
United Kingdom The Chemical Engineer Full timeOur client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and engineering excellence. On the job training would be...
-
Data Engineering Lead Engineer
1 week ago
United Kingdom ON Data Staffing Full timeWe are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...
-
Senior Engineer, Data Engineering
3 weeks ago
United Kingdom La Fosse Full timeSenior Data Engineer 6 month fixed term contract – 2 x a week in London £We're seeking a talented Senior Data Engineer to join the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse....
-
Senior Engineer, Data Engineering
1 day ago
United Kingdom Anson McCade Full time €75,000 - €90,000Senior Data Engineer Location: London Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Design, develop, and maintain robust...
-
Senior Engineer, Data Engineering
1 day ago
United Kingdom Anson McCade Full time €75,000 - €90,000Senior Data Engineer Location: London (2 days a week in office) Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Design,...
-
Senior Engineer, Data Engineering
2 weeks ago
United Kingdom Understanding Recruitment NFP Full timeData Engineer - Charity A brand new and exciting opportunity has recently arisen for a Data Engineer with excellent knowledge in Azure Data Factory, and SQL to join an international charity. This is an excellent opportunity for a Data Engineer to be heavily involved in the biggest data engineering project this charity has ever done! If you are...
-
Senior Engineer, Data Engineering
2 weeks ago
United Kingdom Understanding Recruitment NFP Full timeData Engineer - Charity A brand new and exciting opportunity has recently arisen for a Data Engineer with excellent knowledge in Azure Data Factory, and SQL to join an international charity. This is an excellent opportunity for a Data Engineer to be heavily involved in the biggest data engineering project this charity has ever done! If you are...
