Big Data Engineer

2 weeks ago

London, United Kingdom ubs Full time
United Kingdom

Information Technology (IT)

Group Functions

Job Reference #

294845BR

City

London

Job Type

Full Time

Your role

Do you have proven track record of building big data solutions? Are you confident at iteratively refining user requirements and removing any ambiguity? Do you want to design and build best-in-class, cloud native big data solutions?

We’re looking for a Big Data Lead Engineer to:

• engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud (Azure) data platform infrastructure effectively.
• transform data into valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques.
• develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems.
• ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements.
• build observability into our solutions, monitor production health, help to resolve incidents, and remediate the root cause of risks and issues.
• understand, represent, and advocate for client needs.
• codify best practices, methodology and share knowledge with other engineers in UBS
• shape the Data and Distribution architecture and technology stack within our new cloud-based datalake-house.be a hands-on contributor, senior lead in the big data and data lake space, capable to collaborate and influence architectural and design principles across batch and real time flows
• have a continuous improvement mindset, who is always on the look out for ways to automate and reduce time to market for deliveries

Your Career Comeback

We are open to applications from career returners. Find out more about our program on ubs.com/careercomeback.

Your team

You'll be working in the GM Financing Stream, Prime Brokerage and Swaps Crew, supporting our chapters and pods to take our platform to the cloud. We are a team of dedicated professionals, who are looking to build out our next generation platform to solve complex enterprise-wide problems and the data store in cloud is a key enabler in our cloud journey

Your expertise

• Experience in building Data Processing pipeline using various ETL/ELT design patterns and methodologies to Azure data solution, building solutions using ADLSv2, Azure Data factory, Databricks, Python and PySpark.
• Experience with at least one of the following technologies: Scala/Java or Python
• Deep understanding of the software development craft, with focus on cloud based (Azure), event driven solutions and architectures, with key focus on Apache Spark batch and streaming, Datalakehouses using medallion architecture. Knowledge of DataMesh principles is added plus.
• Ability to debug using tools Ganglia UI, expertise in Optimizing Spark Jobs
• The ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate datasets.
• Expert in creating data structures optimized for storage and various query patterns for e.g. Parquet and Delta Lake
• Experience in traditional data warehousing concepts (Kimball Methodology, Star Schema, SCD) / ETL tools (Azure Data factory, Informatica)
• Experience in data modelling atleast one database technology such as:
• Traditional RDBMS (MS SQL Server, Oracle, PostgreSQL)
• NoSQL (MongoDB, Cassandra, Neo4J, CosmosDB, Gremlin)
• Understanding of Information Security principles to ensure compliant handling and management of data
• Ability to clearly communicate complex solutions.
• Strong problem solving and analytical skills.
• Working experience in Agile methodologies (SCRUM)
• A proven team player with strong leadership skills, who can work in a collaborative way across business units, teams and regions

About us

UBS is the world’s largest and the only truly global wealth manager. We operate through four business divisions: Global Wealth Management, Personal & Corporate Banking, Asset Management and the Investment Bank. Our global reach and the breadth of our expertise set us apart from our competitors..

We have a presence in all major financial centers in more than 50 countries.

How we hire

We may request you to complete one or more assessments during the application process. Learn more

Join us

At UBS, we embrace flexible ways of working when the role permits. We offer different working arrangements like part-time, job-sharing and hybrid (office and home) working. Our purpose-led culture and global infrastructure help us connect, collaborate, and work together in agile ways to meet all our business needs.

From gaining new experiences in different roles to acquiring fresh knowledge and skills, we know that great work is never done alone. We know that it's our people, with their unique backgrounds, skills, experience levels and interests, who drive our ongoing success. Together we’re more than ourselves. Ready to be part of #teamUBS and make an impact?

Disclaimer / Policy Statements

UBS is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills and experiences within our workforce.

  • Big Data Engineer

    1 month ago

    City of London, United Kingdom Understanding Recruitment Full time

    **Big Data Engineer** This organisation has been established for 20+ years and provides cloud-based products and SaaS within the financial industry; specialising is analytics, messaging, archiving and information governance, working 22 of the top 25 global banks and other highlyregulated industries! With the headquarters in Vancouver and offices in New...

  • Big Data Engineer

    3 days ago

    London, United Kingdom Searchability Full time

    **SENIOR BIG DATA ENGINEER - DV CLEARED** **BRAND NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A GLOBALLY LEADING NATIONAL SECURITY COMPANY FOR A BIG DATA ENGINEER** - Permanent job opportunity for a Big Data Engineer - Globally leading defence / cyber security company - Salary up to £60,000 plus clearance bonus - London based organisation in an easily...

  • Senior Big Data Engineer

    1 month ago

    City of London, United Kingdom Understanding Recruitment Full time

    **Senior Big Data Engineer** This organisation has been established for 20+ years and provides cloud-based products and SaaS within the financial industry; specialising is analytics, messaging, archiving and information governance, working 22 of the top 25 global banks and other highlyregulated industries! With the headquarters in Vancouver and offices in...

  • Big Data Engineer

    6 days ago

    London, United Kingdom ubs Full time

    United KingdomInformation Technology (IT)Group FunctionsJob Reference #294845BRCityLondonJob TypeFull TimeYour roleDo you have proven track record of building big data solutions? Are you confident at iteratively refining user requirements and removing any ambiguity? Do you want to design and build best-in-class, cloud native big data solutions?We’re...

  • Big Data Engineer

    2 weeks ago

    London, United Kingdom ubs Full time

    United Kingdom Information Technology (IT) Group Functions Job Reference # 294845BR City London Job Type Full Time Your role Do you have proven track record of building big data solutions? Are you confident at iteratively refining user requirements and removing any ambiguity? Do you want to design and build best-in-class, cloud native big...

  • Data Engineering Manager

    6 hours ago

    London, United Kingdom Cloud Decisions Full time

    Data Engineer - Manager x5 There are data teams and then there are data teams! Our customer puts enterprise at a new scale, not only with the size of their client engagements, but also with their own size as one of the big 4 and one of the first ever Microsoft Global Alliance Partners (*all data technologies will be delivered (GCP/AWS/Big data) although...

  • Junior Big Data Engineer

    4 weeks ago

    London, United Kingdom eFinancialCareers Full time

    **Junior Big Data Engineer** **Tasks**: - Help translate functional requirements into technical requirements - Help develop and implement tools for data acquisition, extraction, transformation, management, and manipulation of large and complex data sets - You'll be involved in all aspects of development - design, development, build, deployment, monitoring...

  • Junior Big Data Engineer

    1 month ago

    London, United Kingdom eFinancialCareers Full time

    **Junior Big Data Engineer** **Tasks**: - Help translate functional requirements into technical requirements - Help develop and implement tools for data acquisition, extraction, transformation, management, and manipulation of large and complex data sets - You'll be involved in all aspects of development - design, development, build, deployment, monitoring...

  • Big Data Architect

    4 days ago

    London, United Kingdom InterEx Group Full time

    For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data.Essential requirements:nMore than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirementsnPrevious experience with the preparation of high-quality...

  • Big Data Engineer

    6 days ago

    London, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud PlatformKey Roles and ResponsibilitiesUnderstand the requirement and analyze the source system...

  • Big Data Engineer

    6 days ago

    London, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud Platform Key Roles and Responsibilities Understand the requirement and analyze the source...

  • Big Data Engineer

    5 days ago

    London, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud Platform Key Roles and Responsibilities Understand the requirement and analyze the source...

  • Big Data Engineer

    5 days ago

    london, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud PlatformKey Roles and ResponsibilitiesUnderstand the requirement and analyze the source system...

  • Big Data Engineer

    5 days ago

    London, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud PlatformConsidering making an application for this job Check all the details in this job...

  • Big Data Engineer

    5 days ago

    London, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud PlatformConsidering making an application for this job Check all the details in this job...

  • Data Software Engineer | Python

    2 months ago

    London, United Kingdom Abs Data Full time

    Regulatory Reporting, Big Data Software Engineer We’re looking for software engineers to: provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services work with our Regulatory Reporting team to translate business and external regulatory needs using Behavior Driven Development...

  • Big Data Engineer

    5 days ago

    London Area, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud PlatformKey Roles and ResponsibilitiesUnderstand the requirement and analyze the source system...

  • Big Data Engineer

    6 days ago

    London Area, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud PlatformKey Roles and ResponsibilitiesUnderstand the requirement and analyze the source system...

  • Big Data Engineer

    4 days ago

    London Area, United Kingdom Thrive IT Systems Ltd Full time

    Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud Platform Key Roles and Responsibilities Understand the requirement and analyze the source system...

  • Big Data Architect

    3 weeks ago

    London, United Kingdom InterEx Group Full time

    For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data.Make sure to apply with all the requested information, as laid out in the job overview below.Essential requirements:More than 3 years of presales experience in the design of Big Data and Data analytics solutions...