Big Data and Performance Optimization Expert

1 week ago


Belfast, United Kingdom Divvy Cloud Corp. Full time
About the Position

We are seeking a highly skilled Data and Performance Engineer to join our team at Divvy Cloud Corp. in Staff Big Data Software Engineer. The successful candidate will be responsible for collaborating with our product teams to optimize their data pipelines and retrieval processes for performance and efficiency.

Responsibilities:

  • Analyse and optimize distributed SQL queries to improve performance
  • Suggest optimisations to our data pipelines
  • Provide recommendations for efficient partitioning strategies and schema designs
  • Conduct performance tuning for the data pipelines and queries
  • Develop performance monitoring strategies and tools

Requirements:

  • 5+ years of hands-on experience in software engineering with a focus on database query optimization
  • Strong expertise in database systems, query execution planning, query optimization, performance tuning, parallel computing, and schema design
  • Experience in continuously monitoring and optimizing data pipelines for performance and cost-effectiveness
  • Ability to design, develop, implement, and operate highly reliable large-scale data lake systems
  • Excellent verbal and written communication skills
  • Strong problem-solving ability

Compensation Package:$180,000 - $220,000 per annum (dependent on experience) plus benefits and stock options



  • Belfast, United Kingdom Tenth Revolution Group Full time

    We are seeking a Big Data Integration Specialist to join our team at the Tenth Revolution Group.Job Summary:You will be responsible for integrating big data solutions using Snowflake, ensuring seamless data flow and optimal performance.You will work closely with cross-functional teams to design and implement data architectures that meet our clients' business...


  • Belfast, United Kingdom DailyPay Inc Full time

    Solving Complex Problems:As a Data Engineer II, you will be responsible for designing and implementing data testing and scaling capabilities, monitoring and alerting for ETL pipelines, data warehouse, and analytics infrastructure, and optimizing database performance while reducing costs and development times. To achieve this, you will need to have 5+ years...

  • Big Data Specialist

    6 days ago


    Belfast, United Kingdom Ingenio Global Full time

    Company Overview:Ingenio Global is a trailblazing FinTech company that specializes in delivering SaaS-based treasury and risk management solutions to organizations worldwide. Our goal is to empower clients to streamline their financial operations, leveraging our cutting-edge tools for cash management, payment processing, risk assessment, and financial...


  • Belfast, United Kingdom Cloudsmith Full time

    At Cloudsmith, we're looking for a skilled Performance Optimization Expert to join our team.We're excited to partner with nineDots to enhance their performance testing capabilities, supporting their remarkable growth.This role offers a unique opportunity to work on optimizing cloud-native software systems and ensuring optimal system performance across all...


  • Belfast, United Kingdom Search 5.0 Full time

    Data Pipeline ExpertiseBelfast-based Search 5.0 is seeking multiple senior data engineers to join their team. This innovative company tackles complex challenges and achieves results across various industries, including healthcare, energy, government, financial services, and consumer products. With a truly collaborative culture, employees are encouraged to...


  • Belfast, United Kingdom Wipro Full time

    We are a leading technology services company focused on delivering innovative solutions that address clients' most complex digital transformation needs. Our ideal candidate will be an expert in Appian server administration, with extensive experience in performance optimization, root cause analysis, and environment configuration.The role involves diagnosing...

  • Big Data Architect

    4 weeks ago


    Belfast, United Kingdom DailyPay Full time

    Senior Data Engineer Job TitleDailyPay seeks a seasoned Senior Data Engineer to lead our data engineering efforts. As a key member of our team, you will design and implement data infrastructure, build data pipelines, and optimize database performance.About the RoleThis is a senior-level position requiring 5+ years of experience in SQL, BI tools, and data...


  • Belfast, United Kingdom Rapid7 Full time

    About the Team The Rapid7 Data Platform is a unified, integrated platform powered by Rapid7’s product suite providing our customers enhanced visibility into their attack surface, operational efficiency, risk management, and decision-making capabilities.  Our teams are responsible for consolidating data from all Rapid7 products, transforming it for...


  • Belfast, United Kingdom PA Consulting Services Ltd Full time

    Company Overview:P.A Consulting Services Ltd is a leading global consulting firm that helps businesses drive innovation and transformation. With a diverse team of experts, we deliver cutting-edge digital solutions to complex business challenges. Our commitment to diversity, inclusion, and employee growth enables us to bring ingenuity to life and deliver...


  • Belfast, United Kingdom Ingenio Global Full time

    Job Title: Cloud Data ArchitectLocation: HQ Based in DublinSalary: £75-90K per annumJob Type: RemoteAbout the Role:Ingenio Global is a leading FinTech company specializing in SaaS-based treasury and risk management solutions. Our mission is to help organizations streamline financial operations, providing tools for cash management, payment processing, risk...


  • Belfast, United Kingdom Corvus Full time

    Job Description: Lead Big Data Solutions ArchitectWe are looking for an experienced Lead Big Data Solutions Architect to join our team at Corvus in Belfast. As a key member of our team, you will be responsible for designing, building, and delivering large-scale data solutions using cutting-edge technologies.About the Role:You will lead the development of...


  • Belfast, United Kingdom Divvy Cloud Corp. Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Divvy Cloud Corp. in Staff Big Data Software Engineer. The successful candidate will be responsible for designing, developing, and implementing high-performance data platforms using big data technologies such as Trino, Iceberg, Parquet, Spark, Airflow, Kafka, and AWS...


  • Belfast, United Kingdom Cloudsmith Full time

    **Job Overview:**As a Cloud Performance Optimization Engineer at Cloudsmith, you will play a crucial role in strengthening our capacity to identify and resolve potential performance bottlenecks across all our systems. Your passion for performance optimization and meticulous eye for detail will ensure optimal system performance.**Key Responsibilities:Apply...


  • Belfast, United Kingdom Citigroup Inc. Full time

    Required Skills and QualificationsTo succeed in this role, you should have an understanding of the Software development lifecycle and Pipeline management, with working experience being an added advantage. Familiarity with monitoring tools, data visualization, Agile concepts, and proficiency in Python, Javascript or willingness to learn is also...

  • Data Engineer

    2 weeks ago


    Belfast, United Kingdom Search 5.0 Full time £45,000 - £60,000

    At Search 5.0, we're seeking a talented Data Engineer to join our Belfast office. As a key member of our team, you'll be responsible for designing and deploying production data pipelines in big data architectures.We're looking for someone with expertise in technologies such as Python, SQL, AWS / Azure, and knowledge of data cleaning, wrangling,...


  • Belfast, United Kingdom Cloudsmith Full time

    nineDots is thrilled to partner with Cloudsmith as they enhance their performance testing capabilities. Cloudsmith is experiencing remarkable growth and the future is looking bright. We're very excited to be playing our part on this journey. Have you got a passion for performance optimization and a meticulous eye for detail? Do you fancy working with a...


  • Belfast, United Kingdom Cloudsmith Full time

    nineDots is thrilled to partner with Cloudsmith as they enhance their performance testing capabilities. Cloudsmith is experiencing remarkable growth and the future is looking bright. We're very excited to be playing our part on this journey. Have you got a passion for performance optimization and a meticulous eye for detail? Do you fancy working with a...


  • Belfast, United Kingdom Cloudsmith Full time

    nineDots is thrilled to partner with Cloudsmith as they enhance their performance testing capabilities. Cloudsmith is experiencing remarkable growth and the future is looking bright. We're very excited to be playing our part on this journey.Have you got a passion for performance optimization and a meticulous eye for detail?Do you fancy working with a...


  • Belfast, United Kingdom Cloudsmith Full time

    nineDots is thrilled to partner with Cloudsmith as they enhance their performance testing capabilities. Cloudsmith is experiencing remarkable growth and the future is looking bright. We're very excited to be playing our part on this journey.Have you got a passion for performance optimization and a meticulous eye for detail?Do you fancy working with a...


  • Belfast, United Kingdom Cloudsmith Full time

    nineDots is thrilled to partner with Cloudsmith as they enhance their performance testing capabilities. Cloudsmith is experiencing remarkable growth and the future is looking bright. We're very excited to be playing our part on this journey. Have you got a passion for performance optimization and a meticulous eye for detail? Do you fancy working with a...