Senior Data Engineer

1 week ago

Camden Area, Greater London, United Kingdom Tata Consultancy Services Full time

Role:

Senior Data EngineernJob Type:

PermanentnLocation:
London (Hybrid)

Ready to utilize your experience in

Data Engineering, Solution designing and Cloud Computing?nAre you passionate about Azure Cloud and Python?nAre you keen to build your career

with a dynamic global IT Consultancy implementing cutting-edge data engineering solutions?nMake a meaningful impact as a

Senior Data Engineer

Careers at

TCS:
It means more.nTCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology.

We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide.

For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.nexposure to innovative customers and identify opportunities to support their strategy and improve their processes across functions.naccess to endless learning opportunities.

The RolenAs a


Senior Data Engineer , you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions.

You will be working with Data Engineers in harnessing the power of Databricks and Synapse to build scalable and efficient data pipelines, data lakes, and analytical solutions.nWith expertise in tools like Airflow for orchestration and GitHub for version control, you will champion DevOps practices to ensure seamless collaboration and automation across the data engineering lifecycle.

Your proficiency in SQL, PySpark, and Python will be helpful in transforming raw data into valuable insights, while your familiarity with Kafka will enable real-time data processing capabilities.


Key responsibilities:

nLead the design, development, and maintenance of Azure-based data pipelines and analytical solutions using Databricks, Synapse, and other relevant services.nLeverage SQL, PySpark, and Python to perform data transformations, aggregations, and analysis on large datasets.nArchitect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance.nCollaborate with cross-functional teams including data scientists, analysts, and software engineers to understand business requirements and deliver impactful data solutions.nMonitor and optimise data pipelines for performance, reliability, and cost-effectiveness, leveraging Azure monitoring and logging services.nImplement best practices for version control and collaboration using GitHub, enabling seamless team collaboration and code management.nEnsure compliance with data governance policies, security standards, and regulatory requirements across all data engineering initiatives.nStay abreast of industry trends and emerging technologies in cloud computing, big data, and analytics, and evaluate their applicability to our data engineering roadmap.nMentor and coach team members on technical skills, best practices, and emerging technologies in the data engineering space.nParticipate in strategic planning and roadmap development for the data engineering function, aligning with organizational goals and objectives.


Your ProfilenKey skills/knowledge/experience:

nexperience in Data Engineering, Solution designing and Cloud Azure cloud services, particularly Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage.nprogramming skills in Python, with experience developing data processing applications using PySpark.

Solid understanding of SQL for data manipulation, querying, and optimisation in Azure version control systems such as GitHub and DevOps practices for automated deployment and infrastructure real-time data streaming technologies such as Kafka for building event-driven architectures.nexperience with CI/CD pipelines for automated testing, build, and deployment of data engineering work effectively in an agile environment, collaborating with cross-functional teams and adapting to changing priorities.ncommunication and interpersonal skills, with the ability to effectively communicate technical concepts to non-technical stakeholders.nproblem-solving abilities and attention to detail, with a focus on delivering high-quality, scalable data master's degree in computer science, engineering, or a related field.


Good to have:

nwith Kafka for building real-time data streaming pipelines and event-driven CI/CD tools such as Azure DevOps or Jenkins for automating the deployment and testing of data engineering agile methodologies such as Scrum or Kanban, and experience working in cross-functional agile containerization technologies such as Docker and orchestration tools like Kubernetes for containerized workflow management tools such as Airflow for orchestrating complex data pipelines and ETL processes.ncertifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem.

Rewards & BenefitsnTCS is consistently voted a Top Employer in the UK and globally.

Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.


Diversity, Inclusion & WellbeingnAt TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive.

Our diversity motto is 'Inclusion without Exception'.nYou'll find a welcoming culture and many internal volunteering and social networks to join.

Our diversity, inclusion and social activities involve 12 employee networks including LGBTQ+ & Allies, mental health, disability & neurodiversity inclusion and many more, as well as health & wellness initiatives and sports events (we even sponsor the London Marathon).nWe are open to all and treat applications equally, regardless of ethnicity, disability, gender identity, gender reassignment, age, sexual orientation, or beliefs.

nIf you are an applicant who needs a reasonable accommodation due to Disability or Neurodiverse Condition to complete an employment application, or during any phase of the hiring process, please contact us at

with the subject line:
"Reasonable Accommodation Request".nDue to a high volume of applications, we will be unable to contact each applicant individually on the status of their application. If you have not received a direct response within 30 days, then it should be deemed unsuccessful on this occasion.

Application Processn1. Online application > 2. Technical discussion > 3. Managerial discussion > 4. HR discussion (EP role – usually)

  • Senior Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Xcede Full time

    Senior Data Engineer (AWS)nUp to £85,000 Salary + BonusnLondon office 2-3 days per week.OVERVIEWA very successful AI scale up in the creative space are hiring for a Senior Data Engineer (AWS) to join their well established Data team, spearheading some of their key Data Engineering projects in AWS and mentoring junior team members.Your responsibilities as a...

  • Senior Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Michael James Associates Full time

    Senior Data Engineer Python . London / Hybrid working. Salary from £80, 000 to £110, 000 plus generous benefits package.MJA are working with a major UK financial services related company who are looking for a Senior Data Engineer (Python) to join their growing Data team. Within this varied role you will take ownership of Data related projects which will...

  • Senior Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Burns Sheehan Full time

    Senior Data Engineer at Rapidly Growing Highstreet Brand About the company: Burns Sheehan is proud to be partnering with a rapidly growing high-street chain that has been experiencing significant success recently and is now expanding both in the UK and internationally. This is an exciting opportunity to play a crucial role in shaping the data strategy and...

  • Senior Data Engineer

    7 days ago

    Camden Area, Greater London, United Kingdom Harrington Starr Full time

    Senior Data EngineernFinancial ServicesnLondon (Hybrid)n£90K plus bonuses and benefitsHarrington Starr has partnered with leading data and analytics firm on the forefront of capital markets innovation as they seek to hire an experienced Data Engineer. Our client extends its services to global exchange groups, banks, brokers, asset managers, and hedge...

  • Senior SAS Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom PURVIEW Full time

    We are hiring a Senior SAS Data Engineer for one of our esteemed clients.Role: Senior SAS Data EngineerLocation: London & EdinburghDuration: Permanent and ContractWork Mode: Fully remote with occasional travel required.We are in search of a skilled Senior SAS Data Engineer to join our team.Job Description:As a Senior Data Engineer (SAS), you will be...

  • Senior Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Harrington Starr Full time

    Senior Data EngineernAWS / Bedrock / Glue / EKS / RedshiftnContract - Inside - LondonHarrington Starr have partnered exclusively with a long-standing client of ours within the commodities trading space who are looking to increase headcount within their Data Engineering team at the start of the year here with 2024.The role will require you to have:n5+ years...

  • Senior Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Velocity Tech Full time

    Velocity Tech has partnered with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our dynamic team.Responsibilities:nExperience designing data models and developing industrialized data pipelines.nStrong knowledge of database and data lake systems,...

  • Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Scalexperts Full time

    Data Engineer - Databricks - £70-75,000 - London/HybridScalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function.They are looking for a Data Engineer to join them to work on building a brand new data platform which is still in early stage...

  • Senior Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Freshminds Full time

    A high growth global events business are searching for a Senior Data Engineer to join their Data and Analytics division.The successful candidate will have the opportunity to work in a close knit and high performing team that operates at group level.Key ResponsibilitiesnData Platform Design:Lead the creation and optimization of data platforms for CRM,...

  • Senior Data Engineer

    7 days ago

    Camden Area, Greater London, United Kingdom X4 Technology Full time

    A leading Energy & Commodities client is seeking a Senior Data Engineer to join their growing IT team on an initial 6 month contract basis with high chance of extension thereafter to over 12 months. The role requires the individual to work with Solution and Data Architects to design the next generation Big Data platform to support the digital marketing...

  • Senior Data Engineer – Ecommerce

    7 days ago

    Camden Area, Greater London, United Kingdom Ventula Consulting Full time

    Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy.This engineer will shape our client's data function, delivering end to end solutions for an array of customer data projects.The role:nDesigning data pipelines, managing data warehouses, and implementing complex ETL processes.nWork...

  • Data Engineer

    7 days ago

    Camden Area, Greater London, United Kingdom Response Informatics Full time

    We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.nYour tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for business...

  • Senior Data Engineering Lead

    1 week ago

    Camden Area, Greater London, United Kingdom DATAHEAD Full time

    Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120, % Bonus 2 days in the office per week (Central London) A top global insurer is undergoing a significant transformation to establish itself as the standard for excellence across all its insurance markets. Utilizing an advanced Data and Analytics strategy, we are reshaping...

  • Senior Data Analytics Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Orbis Group Full time

    Title – Senior Data Analytics EngineernBase – up to £105,000 + bonusnLocation – LondonnFlexibility – Hybrid, 3 days a week in officeAbout the companynOrbis has partnered with an exciting multi-national Fintech unicorn specialising in payment platforms.nThey work with a variety of exciting and well-known brands such as Klarna and Sony, as well as...

  • Senior Data Engineer

    7 days ago

    Camden Area, Greater London, United Kingdom Selby Jennings Full time

    Working with a top tier Digital Asset Management firm who are looking for an adept and experienced Data Engineer to play a critical role in shaping and managing their data engineering platform. This role demands strong technical skills and a proven ability to work closely with quantitative researchers, ensuring seamless integration of data engineering...

  • Senior Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Talent Search Technology Full time

    Role: Principal - Data EngineeringnLocation: London/Edinburgh, UKnWork Mode: Hybrid-3 days a weekJOB DETAILSMust Have - Platform engineer, Azure DevOps and CI/CD tools, Azure Cloud, Microsoft Fabric, Azure Services, Apache Spark,nExperience of using IAC (terraform, APIs), Data Engineer, Big Data, PySpark

  • Senior Data Engineer

    1 week ago

    Camden Area, Greater London, United Kingdom Franklin Fitch Full time

    Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for youPosition:Lead Data EngineerResponsibilities:Lead Data Management and Architecture:Spearhead the design and implementation of robust...

  • Senior Data Scientist

    7 days ago

    Camden Area, Greater London, United Kingdom W Talent Full time

    W Talent are currently working with a company within the Financial Services space who are growing rapidly and looking for a Senior Data Scientist.This is a great opportunity for somebody who has a few years experience within data science with exposure to Data Engineering / ML.Job Responsibilities / Outline of jobUtilize advanced statistical techniques and...

  • Senior Data Analyst

    7 days ago

    Camden Area, Greater London, United Kingdom Espire Infolabs Full time

    Job Title: Senior Data AnalystThis position is based in London, UK with the option to work remotely and occasional travel. As a Senior Data Analyst, you will play a crucial role in transforming complex data sets into valuable insights that drive strategic business decisions.Key Responsibilities:Collaborate with Data/Analytics analysts, data engineers,...

  • Senior Data Scientist

    1 week ago

    Camden Area, Greater London, United Kingdom Open Select Recruitment Full time

    Our client is a leading fintech company dedicated to revolutionizing the financial services industry. They leverage advanced analytics, machine learning, and cutting-edge technology to deliver innovative financial solutions to their clients. Their mission is to make financial services more accessible, efficient, and personalised.Job Description:nWe are...