Data Engineer for Scalable Data Solutions

6 hours ago


Belfast, United Kingdom Divvy Cloud Corp. Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team at Divvy Cloud Corp. in Staff Big Data Software Engineer. The successful candidate will be responsible for designing, developing, and implementing high-performance data platforms using big data technologies such as Trino, Iceberg, Parquet, Spark, Airflow, Kafka, and AWS services.

Responsibilities:

  • Design and implement scalable data pipelines using Trino, Iceberg, and Parquet
  • Optimize distributed SQL queries for improved performance
  • Develop performance monitoring strategies and tools
  • Collaborate with product teams to optimize data retrieval processes
  • Analyse and optimize data pipelines for cost-effectiveness

Requirements:

  • 5+ years of hands-on experience in software engineering with a focus on database query optimization
  • Strong expertise in database systems, query execution planning, query optimization, performance tuning, parallel computing, and schema design
  • Experience in continuously monitoring and optimizing data pipelines for performance and cost-effectiveness
  • Ability to design, develop, implement, and operate highly reliable large-scale data lake systems
  • Excellent verbal and written communication skills
  • Strong problem-solving ability

Salary:$140,000 - $170,000 per annum (depending on experience)


  • Data Engineer

    2 months ago


    Belfast, United Kingdom Data Intellect Full time

    Job DescriptionWhat you’ll be doing:Build and enhance bespoke Data Science and Engineering solutions for our clientsEnhance and grow your data science and engineering knowledge among subject matter experts in our learning and development ecosystem Deliver high quality, best practice software solutions Use a range of architectures, tools and...


  • Belfast, United Kingdom Data Intellect Full time

    Job DescriptionWe are seeking a highly skilled Data Scientist and Engineer to join our team at Data Intellect. As a key member of our data science and engineering team, you will be responsible for designing, developing, and implementing data-driven solutions for our clients.Key Responsibilities:Design and develop bespoke data science and engineering...

  • Data Engineer

    4 weeks ago


    Belfast, United Kingdom Data Intellect Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team at Data Intellect. As a Data Engineer, you will be responsible for designing, developing, and implementing data-driven solutions that transform our clients' businesses.Key ResponsibilitiesDesign and Develop Data-Driven SolutionsCollaborate with Cross-Functional TeamsImplement and...


  • Belfast, United Kingdom Data Intellect Full time

    Role OverviewData Engineering ProfessionalAbout Data IntellectWe are a leading provider of data-driven solutions, utilizing cutting-edge technology to deliver results-driven outcomes.Culture and ValuesOur team is built on core values of innovation, collaboration, and customer satisfaction, driving our pursuit of excellence.Job ResponsibilitiesIn this role,...


  • Belfast, United Kingdom DailyPay Full time

    Company Overview:DailyPay provides an industry-leading earned wage access platform, processing applications via employer's online application form.We are seeking a Staff Data Architect Engineer to work with software developers, database architects, data analysts, and data scientists on various data initiatives, ensuring consistent, efficient, and scalable...


  • Belfast, United Kingdom Exceptional Dental Full time

    Foods Connected is an award-winning cloud-based software platform helping retailers and food companies worldwide manage their supply chain, quality control, and trading and planning management.Our software solutions are currently utilised by 10 of the largest food retailers globally. As a team, we provide tools that help our customers manage processes...


  • Belfast, United Kingdom Data Intellect Full time

    About the RoleWe are looking for a highly skilled AWS Python Engineer to join our team at Data Intellect. As a key member of our engineering department, you will work on a variety of projects, from designing and implementing new systems to enhancing and maintaining existing ones.Key ResponsibilitiesYour responsibilities will include:Designing and developing...


  • Belfast, United Kingdom Search 5.0 Full time €90,000

    Principal Data Engineer - Belfast We're working with one of the most reputable employers in Belfast who are know for both technical innovation, and leading the way in culture and inclusion. They have a brand new opportunity for a Principal Data Engineer to lead the data architecture and engineering team in Belfast. You'll be responsible for designing...

  • Python Engineer

    3 weeks ago


    Belfast, United Kingdom Data Intellect Full time

    Job Description What you'll be doing: · Build and enhance bespoke Python & Data Engineering solutions for our clients · Enhance and grow your data engineering knowledge among subject matter experts in our learning and development ecosystem · Deliver high quality, best practice software solutions · Use a range of architectures, tools and frameworks ·...


  • Belfast, United Kingdom Workonblockchain Full time

    We are seeking a highly skilled Senior Software Engineer to join our team at Workonblockchain, a pioneering company in the Research sector, focused on Tech for Good. As a key member of our software development team, you will have the opportunity to work on cutting-edge software solutions that drive innovation and make a positive impact.About the RoleThis is...

  • Lead Data Engineer

    4 weeks ago


    Belfast, United Kingdom Divvy Cloud Corp. Full time

    Job SummaryWe are seeking a Lead Data Engineer to join our Data Platform Engineering team at Divvy Cloud Corp. As a key member of the team, you will be responsible for leading the design and implementation of scalable data pipelines using Apache Kafka, Apache Iceberg, and Apache Spark.You will work closely with cross-functional teams to deliver highly...


  • Belfast, United Kingdom Data Intellect Full time

    descriptions3':['About Data IntellectData Intellect is a specialist data and technology consultancy providing innovative solutions for the financial industry. Our team of experts leverages its knowledge in Q programming language and kdb+ time series database, developed by KX Systems, to help clients navigate complex data landscapes.]Graduate OpportunityWe...

  • Data Engineering Lead

    4 weeks ago


    Belfast, United Kingdom Search 5.0 Full time

    Transform Your Career with a Challenging Role in Data EngineeringAt Search 5.0, we're seeking a talented Principal Data Engineer to lead our data architecture and engineering team in Belfast. As a key member of our team, you'll be responsible for designing and implementing scalable data solutions, optimizing pipelines, and mentoring junior engineers.Develop...


  • Belfast, United Kingdom DailyPay Belfast Full time

    About DailyPay BelfastAs the industry's leading on-demand pay solution, DailyPay uses an award-winning technology platform to help top employers build stronger relationships with their employees.Competitive Compensation PackageOur competitive compensation package includes a salary of $125,000 - $150,000 per year, private health insurance option, fun company...


  • Belfast, United Kingdom Bazaarvoice Full time

    About the RoleBazaarvoice is seeking an experienced Data Systems Engineer - Cloud Native Expert to help us drive innovation in data engineering. As a key member of our team, you'll be responsible for designing, building, and supporting large-scale, distributed data systems that power our organization's data infrastructure. This is an exciting opportunity to...

  • Lead Data Engineer

    3 months ago


    Belfast, United Kingdom Search 5.0 Full time

    Principal Data Engineer - BelfastWe're working with one of the most reputable employers in Belfast who are know for both technical innovation, and leading the way in culture and inclusion.They have a brand new opportunity for a Principal Data Engineer to lead the data architecture and engineering team in Belfast. You'll be responsible for designing and...

  • Lead Data Engineer

    3 months ago


    Belfast, United Kingdom Search 5.0 Full time

    Principal Data Engineer - BelfastWe're working with one of the most reputable employers in Belfast who are know for both technical innovation, and leading the way in culture and inclusion.They have a brand new opportunity for a Principal Data Engineer to lead the data architecture and engineering team in Belfast. You'll be responsible for designing and...

  • Lead Data Engineer

    1 month ago


    Belfast, United Kingdom Search 5.0 Full time

    Principal Data Engineer - Belfast We're working with one of the most reputable employers in Belfast who are know for both technical innovation, and leading the way in culture and inclusion. They have a brand new opportunity for a Principal Data Engineer to lead the data architecture and engineering team in Belfast. You'll be responsible for...

  • Lead Data Engineer

    3 months ago


    Belfast, United Kingdom Search 5.0 Full time €90,000

    Principal Data Engineer - Belfast We're working with one of the most reputable employers in Belfast who are know for both technical innovation, and leading the way in culture and inclusion. They have a brand new opportunity for a Principal Data Engineer to lead the data architecture and engineering team in Belfast. You'll be responsible for...

  • Lead Data Engineer

    3 months ago


    Belfast, United Kingdom Search 5.0 Full time

    Principal Data Engineer - BelfastWe're working with one of the most reputable employers in Belfast who are know for both technical innovation, and leading the way in culture and inclusion.They have a brand new opportunity for a Principal Data Engineer to lead the data architecture and engineering team in Belfast. You'll be responsible for designing and...