Senior Data Engineer

2 weeks ago

United Kingdom Tata Consultancy Services Full time

Role: Senior Data Engineer

Job Type: Permanent

Location: London (Hybrid)

Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing?

Are you passionate about Azure Cloud and Python?

Are you keen to build your career with a dynamic global IT Consultancy implementing cutting-edge data engineering solutions?

Make a meaningful impact as a Senior Data Engineer

Careers at TCS: It means more.

TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

  • exposure to innovative technology.
  • with customers and identify opportunities to support their strategy and improve their processes across functions.
  • access to endless learning opportunities.

The Role

As a Senior Data Engineer , you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. You will be working with Data Engineers in harnessing the power of Databricks and Synapse to build scalable and efficient data pipelines, data lakes, and analytical solutions.

With expertise in tools like Airflow for orchestration and GitHub for version control, you will champion DevOps practices to ensure seamless collaboration and automation across the data engineering lifecycle. Your proficiency in SQL, PySpark, and Python will be helpful in transforming raw data into valuable insights, while your familiarity with Kafka will enable real-time data processing capabilities.

Key responsibilities:

Lead the design, development, and maintenance of Azure-based data pipelines and analytical solutions using Databricks, Synapse, and other relevant services.

Leverage SQL, PySpark, and Python to perform data transformations, aggregations, and analysis on large datasets.

Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance.

Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand business requirements and deliver impactful data solutions.

Monitor and optimise data pipelines for performance, reliability, and cost-effectiveness, leveraging Azure monitoring and logging services.

Implement best practices for version control and collaboration using GitHub, enabling seamless team collaboration and code management.

Ensure compliance with data governance policies, security standards, and regulatory requirements across all data engineering initiatives.

Stay abreast of industry trends and emerging technologies in cloud computing, big data, and analytics, and evaluate their applicability to our data engineering roadmap.

Mentor and coach team members on technical skills, best practices, and emerging technologies in the data engineering space.

Participate in strategic planning and roadmap development for the data engineering function, aligning with organizational goals and objectives.

Your Profile

Key skills/knowledge/experience:

  • experience in Data Engineering, Solution designing and Cloud Computing.
  • in Azure cloud services, particularly Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage.
  • programming skills in Python, with experience developing data processing applications using PySpark. Solid understanding of SQL for data manipulation, querying, and optimisation in Azure environments.
  • with version control systems such as GitHub and DevOps practices for automated deployment and infrastructure management.
  • of real-time data streaming technologies such as Kafka for building event-driven architectures.
  • experience with CI/CD pipelines for automated testing, build, and deployment of data engineering solutions.
  • to work effectively in an agile environment, collaborating with cross-functional teams and adapting to changing priorities.
  • communication and interpersonal skills, with the ability to effectively communicate technical concepts to non-technical stakeholders.
  • problem-solving abilities and attention to detail, with a focus on delivering high-quality, scalable data solutions.
  • or master’s degree in computer science, engineering, or a related field.

Good to have:

  • with Kafka for building real-time data streaming pipelines and event-driven architectures.
  • with CI/CD tools such as Azure DevOps or Jenkins for automating the deployment and testing of data engineering solutions.
  • of agile methodologies such as Scrum or Kanban, and experience working in cross-functional agile teams.
  • of containerization technologies such as Docker and orchestration tools like Kubernetes for containerized deployments.
  • with workflow management tools such as Airflow for orchestrating complex data pipelines and ETL processes.
  • certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem.

Rewards & Benefits

TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.

Diversity, Inclusion & Wellbeing

At TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity motto is ‘Inclusion without Exception’.

You’ll find a welcoming culture and many internal volunteering and social networks to join. Our diversity, inclusion and social activities involve 12 employee networks including LGBTQ+ & Allies, mental health, disability & neurodiversity inclusion and many more, as well as health & wellness initiatives and sports events (we even sponsor the London Marathon).

We are open to all and treat applications equally, regardless of ethnicity, disability, gender identity, gender reassignment, age, sexual orientation, or beliefs.

If you are an applicant who needs a reasonable accommodation due to Disability or Neurodiverse Condition to complete an employment application, or during any phase of the hiring process, please contact us at kowsalya.kumar@tcs.com with the subject line: “Reasonable Accommodation Request”.

Due to a high volume of applications, we will be unable to contact each applicant individually on the status of their application. If you have not received a direct response within 30 days, then it should be deemed unsuccessful on this occasion.

Application Process

1. Online application > 2. Technical discussion > 3. Managerial discussion > 4. HR discussion (EP role – usually)

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    2 months ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    2 months ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    2 months ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    2 months ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    1 month ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Engineering

    4 days ago

    United Kingdom The Engineer Full time €75,000

    Head of Future Engineering & International Co-ordination - FCAS Join us in crafting and delivering the Future Combat Air Programme (FCAS) for the RAF in record time! As the Senior Engineering representative leading a multifunctional team of experts, you will hold a significant position within the Programme. Reporting into the Chief Engineer and with...

  • Senior Data Scientist

    2 weeks ago

    United Kingdom Data Science Talent Full time

    Senior Data Scientist - F1 Motorsports Location: The time it takes to service an entire F1 racing car at the pit stop. The data you and your team help to deliver could make or break lap time for one of the world's leading Formula 1 teams. A lap time that over 500 million people will see at the most-watched annual sporting series in the world. ...

  • Senior Data Scientist

    2 weeks ago

    United Kingdom Data Science Talent Full time

    Senior Data Scientist - F1 Motorsports Location: The time it takes to service an entire F1 racing car at the pit stop. The data you and your team help to deliver could make or break lap time for one of the world's leading Formula 1 teams. A lap time that over 500 million people will see at the most-watched annual sporting series in the world. ...

  • Process Engineering

    2 months ago

    United Kingdom The Chemical Engineer Full time

    Our client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and engineering excellence. On the job training would be...

  • Data Scientist

    1 week ago

    United Kingdom Data Science Talent Full time

    Data Scientist / Senior Data Scientist - F1 Motorsport Location: South East England -----2.62 seconds. The time it takes to service an entire F1 racing car at the pit stop. 2 weeks. How soon you could see the impact of your work translating into visible results for the team on the track. The data you and your team help to deliver could make or break lap...

  • Data Scientist

    1 week ago

    United Kingdom Data Science Talent Full time

    Data Scientist / Senior Data Scientist - F1 Motorsport Location: South East England -----2.62 seconds. The time it takes to service an entire F1 racing car at the pit stop. 2 weeks. How soon you could see the impact of your work translating into visible results for the team on the track. The data you and your team help to deliver could make or break lap...

  • Senior Civil Engineer

    3 days ago

    United Kingdom Abs Data Full time

    Senior Civil Engineer With more than 55,000 people in 40 countries, working at Jacobs offers an exciting range of opportunities to develop your career within a supportive and diverse team who always strive to do the right thing for our people, clients and communities. People are Jacobs’ greatest asset, and we offer a competitive package to retain and...

  • Lead Data Engineer-Data Management

    2 months ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Integration Engineer

    2 months ago

    United Kingdom Abs Data Full time

    Big Data Integration Engineer Saint-Gobain Position description Are you someone who is passionate about data and transformation? At Saint-Gobain Digital, we are looking for a Big Data Integration Engineer to work remotely to create customer and business value as part of a digital transformation. This Data Engineer will be a part of our enthusiastic...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI...

  • Data Engineering Lead Engineer

    1 week ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Scientist

    1 week ago

    united kingdom Data Science Talent Full time

    Data Scientist / Senior Data Scientist - F1 MotorsportLocation: South East England-----2.62 seconds. The time it takes to service an entire F1 racing car at the pit stop.2 weeks. How soon you could see the impact of your work translating into visible results for the team on the track.The data you and your team help to deliver could make or break lap time for...