Senior Data Engineer

2 weeks ago

London Area, United Kingdom Tata Consultancy Services Full time

Role: Senior Data Engineer

Job Type: Permanent

Location: London (Hybrid)


Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing?

Are you passionate about Azure Cloud and Python?

Are you keen to build your career with a dynamic global IT Consultancy implementing cutting-edge data engineering solutions?

Make a meaningful impact as a Senior Data Engineer


Careers at TCS: It means more.

TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

  • exposure to innovative technology.
  • with customers and identify opportunities to support their strategy and improve their processes across functions.
  • access to endless learning opportunities.


The Role

As a Senior Data Engineer, you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. You will be working with Data Engineers in harnessing the power of Databricks and Synapse to build scalable and efficient data pipelines, data lakes, and analytical solutions.

With expertise in tools like Airflow for orchestration and GitHub for version control, you will champion DevOps practices to ensure seamless collaboration and automation across the data engineering lifecycle. Your proficiency in SQL, PySpark, and Python will be helpful in transforming raw data into valuable insights, while your familiarity with Kafka will enable real-time data processing capabilities.


Key responsibilities:

Lead the design, development, and maintenance of Azure-based data pipelines and analytical solutions using Databricks, Synapse, and other relevant services.

Leverage SQL, PySpark, and Python to perform data transformations, aggregations, and analysis on large datasets.

Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance.

Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand business requirements and deliver impactful data solutions.

Monitor and optimise data pipelines for performance, reliability, and cost-effectiveness, leveraging Azure monitoring and logging services.

Implement best practices for version control and collaboration using GitHub, enabling seamless team collaboration and code management.

Ensure compliance with data governance policies, security standards, and regulatory requirements across all data engineering initiatives.

Stay abreast of industry trends and emerging technologies in cloud computing, big data, and analytics, and evaluate their applicability to our data engineering roadmap.

Mentor and coach team members on technical skills, best practices, and emerging technologies in the data engineering space.

Participate in strategic planning and roadmap development for the data engineering function, aligning with organizational goals and objectives.


Your Profile

Key skills/knowledge/experience:

  • experience in Data Engineering, Solution designing and Cloud Computing.
  • in Azure cloud services, particularly Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage.
  • programming skills in Python, with experience developing data processing applications using PySpark. Solid understanding of SQL for data manipulation, querying, and optimisation in Azure environments.
  • with version control systems such as GitHub and DevOps practices for automated deployment and infrastructure management.
  • of real-time data streaming technologies such as Kafka for building event-driven architectures.
  • experience with CI/CD pipelines for automated testing, build, and deployment of data engineering solutions.
  • to work effectively in an agile environment, collaborating with cross-functional teams and adapting to changing priorities.
  • communication and interpersonal skills, with the ability to effectively communicate technical concepts to non-technical stakeholders.
  • problem-solving abilities and attention to detail, with a focus on delivering high-quality, scalable data solutions.
  • or master’s degree in computer science, engineering, or a related field.


Good to have:

  • with Kafka for building real-time data streaming pipelines and event-driven architectures.
  • with CI/CD tools such as Azure DevOps or Jenkins for automating the deployment and testing of data engineering solutions.
  • of agile methodologies such as Scrum or Kanban, and experience working in cross-functional agile teams.
  • of containerization technologies such as Docker and orchestration tools like Kubernetes for containerized deployments.
  • with workflow management tools such as Airflow for orchestrating complex data pipelines and ETL processes.
  • certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem.


Rewards & Benefits

TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.


Diversity, Inclusion & Wellbeing

At TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity motto is ‘Inclusion without Exception’.

You’ll find a welcoming culture and many internal volunteering and social networks to join. Our diversity, inclusion and social activities involve 12 employee networks including LGBTQ+ & Allies, mental health, disability & neurodiversity inclusion and many more, as well as health & wellness initiatives and sports events (we even sponsor the London Marathon).

We are open to all and treat applications equally, regardless of ethnicity, disability, gender identity, gender reassignment, age, sexual orientation, or beliefs.

If you are an applicant who needs a reasonable accommodation due to Disability or Neurodiverse Condition to complete an employment application, or during any phase of the hiring process, please contact us at kowsalya.kumar@tcs.com with the subject line: “Reasonable Accommodation Request”.

Due to a high volume of applications, we will be unable to contact each applicant individually on the status of their application. If you have not received a direct response within 30 days, then it should be deemed unsuccessful on this occasion.


Application Process

1. Online application > 2. Technical discussion > 3. Managerial discussion > 4. HR discussion (EP role – usually)

  • Senior Engineer, Data Engineering

    4 weeks ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Senior Engineer, Data Engineering

    4 weeks ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to design,...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, United Kingdom Data Idols Full time

    Job Description Senior Data Engineer Location: London (Hybrid) Data Idols are working with one of the fast-growing companies in the logistics sector that are making the world a greener place. They are looking for a Senior Data Engineer to join their team within the Data Space. As a Senior Data Engineer, you will work alongside different data teams to...

  • Senior Data Engineer

    1 month ago

    London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with a company who has a mission to improve the lives of learners globally, who want to build a more sustainable future everyone can reach their potential in. Do you want to be a part of a change into the sustainable future? **The Opportunity** Within this role as a Senior Data Engineer you will be...

  • Senior Data Engineer

    4 weeks ago

    London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools,...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...

  • Senior Engineer, Data Engineering

    2 months ago

    London, United Kingdom Data Idols Full time

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener! Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with...

  • Data Engineer

    1 month ago

    City of London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key partof their future plans. **The Opportunity** As a Senior Data Engineer you will be...

  • Senior Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **Salary: £70,000 - £90,000** **LONDON** This is an extremely technically driven company offering many benefits. They are data-driven and are situated globally, streaming and using data to best help their customer. **THE COMPANY** This global data company is heavily driven by Data and Analytics and is looking for a Senior Data...

  • Senior Data Engineer

    4 days ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **UP TO £100,000 + BENEFITS** **LONDON, CURRENTLY REMOTE / HOMEWORKING** I am working with a fintech that is looking for a Senior Data Engineer to join their new product team! Great tech stack, growth potential, and lots of autonomy **THE COMPANY**: This is a fast-growing fintech that is looking for a Senior Data Engineer to join...

  • Senior Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **LONDON/REMOTE** **£70,000-80,000 PER ANNUM** This expanding power company are searching for a new Senior Data Engineer. You will be responsible for working with architects to design and build Data Pipelines using Python. You will be responsible for analysing new technologies and techniques and introducingthese to the...

  • Senior Data Engineer

    11 hours ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **UP TO £95,000 + BENEFITS** **LONDON, CURRENTLY HYBRID WORKING** Harnham has partnered with a retail company that is taking more of a turn to a tech-focused business. They are looking for a Senior Data Engineer to scale up their data team and create a data-driven culture. **THE COMPANY**: This is a retail company that is looking...

  • Senior Data Engineer

    4 days ago

    London, United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Engineer, Data Engineering

    20 hours ago

    London, United Kingdom Abs Data Full time

    Data Engineer With more than 55,000 people in 40+ countries, working at Jacobs offers an exciting range of opportunities to develop your career within a supportive and diverse team who always strive to do the right thing for our people, clients and communities. People are Jacobs’ greatest asset, and we offer a competitive package to retain and attract...

  • Senior Consultant

    1 month ago

    London, United Kingdom Data Idols Full time

    Senior Analytics Consultant Brighton - Hybrid/Remote Data Idols are working with a Google Cloud Consultancy that helps organisations transform their data analytics functions using modern technologies. With clients across the globe, they are looking for a Senior Analytics Consultant to join their expanding team. As a Senior Analytics Consultant, you...

  • Senior Data Engineer

    3 days ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **£80,000 - £100,000** **LONDON** Are you an experienced Data Engineer who is looking to work in the FinTech industry? This opportunity offers the chance to work closely with a small group of data specialists on an exciting and expanding greenfield project! **THE COMPANY** This company has begun placing products into the...

  • Senior Data Engineer

    7 days ago

    London Area, United Kingdom Better Placed Ltd - A Sunday Times Top 10 Employer in 2023! Full time

    Senior Data Engineer – West London - £100,000DescriptionI am seeking a highly skilled Senior Data Engineer to join an innovative team for one of my clients who specialise in computer software. As a Senior Data Engineer, you will be responsible for the development, implementation, and maintenance of our data infrastructure, ensuring the efficient and...

  • Senior Data Engineer

    4 days ago

    London Area, United Kingdom Better Placed Ltd - A Sunday Times Top 10 Employer in 2023! Full time

    Senior Data Engineer – West London - £100,000 Description I am seeking a highly skilled Senior Data Engineer to join an innovative team for one of my clients who specialise in computer software. As a Senior Data Engineer, you will be responsible for the development, implementation, and maintenance of our data infrastructure, ensuring the efficient and...

  • Senior Data Engineer

    1 week ago

    London Area, United Kingdom Better Placed Ltd - A Sunday Times Top 10 Employer in 2023! Full time

    Senior Data Engineer – West London - £100,000DescriptionI am seeking a highly skilled Senior Data Engineer to join an innovative team for one of my clients who specialise in computer software. As a Senior Data Engineer, you will be responsible for the development, implementation, and maintenance of our data infrastructure, ensuring the efficient and...

  • Data Engineer

    1 month ago

    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER** **SALARY: £40,000 - £48,000** **LONDON** An innovative and data-driven company is looking for an up-and-coming intelligent Data Engineer that can help drive the business to new heights. Allowing this individual to join a flat structure and a team using a modern tech stack. **THE COMPANY** This company is extremely data-driven...