Data and Software Engineer

4 weeks ago

United Kingdom Input Output Hong Kong Full time

Summary

You are part of the Technical Intelligence (TechInt) team. The team’s main function is to recon the blockchain industry and feed the company with new trends and projects. The TechInt team has automatized the recon process by utilizing a data lake and machine learning.

You are responsible for maintaining and setting up data solutions and services. In your daily job, you do a mix of data engineering, software coding, and infrastructure management.

You work closely with leadership to understand and define requirements. You ensure alignment with the department’s strategy and roadmap. You work together with a Data Scientist and an Intelligence Engineer to implement the technical solutions. You ensure the systems are functional and available.

Duties

  • Develop and maintain automated data ingestion pipelines from source code repositories, social media, and on-chain analytics.
  • Develop and maintain data cleaning and transformation solutions.
  • Develop web solutions (both back-end and front-end) for exploring data insights.
  • Maintain machine learning (ML) models in production pipelines.
  • Develop and maintain a knowledge management system to enable content by the systems’ customers.
  • Integrate and maintain Large Language Models (LLM) within the processing pipeline and develop a prompt-like user interface.
  • Maintain the remote infrastructure required to store, process, and visualize data.

Key competencies

  • Knowledge of big data processing platforms (e.g., Spark, Databricks, Google BigQuery), data orchestration (e.g., Airflow), and data manipulation libraries (e.g., Pandas, Polars).
  • Familiarity with machine learning platforms and libraries such as TensorFlow, PyTorch, or similar.
  • Knowledge of front-end languages and libraries (e.g., HTML/ CSS, JavaScript, XML, jQuery).
  • Knowledge of back-end languages (e.g., Python).
  • Knowledge of relational databases (e.g., PostgreSQL), web servers (e.g., Nginx), and UI/UX design.
  • Knowledge of Docker, Kubernetes, and familiarity with Continuous Integration and Continuous Delivery (CI/CD) pipelines.
  • Experience with cloud services (e.g., AWS, Google Cloud)
  • Ability to communicate well both verbally and in writing, with both technical and non-technical partners.

Education/Experience

  • BSc/MSc in a Computer Science field, or equivalent practical experience.
  • 5+ years of work experience in data and software engineering : data storage, data manipulation, front-end and back-end development for software applications and data systems.
  • Preferable work experience with blockchain.
  • Professional English.

Location

IOG is a fully distributed organization but due to team distribution, we require someone to be based either in Ireland or the UK.

All colleagues

  • Flexible schedule
  • Remote work
  • Laptop reimbursement
  • New starter package to buy hardware essentials (headphones, monitor, etc)
  • Learning & Development opportunities
  • Competitive PTO and Sick Leave plan

UK & Ireland Employees

  • Monthly Health Stipend to use towards any wellness or medical coverage/service
  • Pension

At IOG, we value diversity and always treat all employees and job applicants based on merit, qualifications, competence, and talent. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

#J-18808-Ljbffr

  • Marketing Data Scientist

    4 weeks ago

    United Kingdom Ascent Software Full time

    This is a perfect opportunity for ambitious individuals to join a team of curious mindsand support peerswith a passion and the skills for creating value for businesses using data. Ascent is a design-led software, data and cloud business that specialises in advanced analytics and AI. We are an engineering business. We design, build and manage cloud-native...

  • Senior Software Engineer

    1 week ago

    United Kingdom Python Software Foundation Full time

    You will work as part of a close-knit team to continue the development of analysis and control software for TeraView’s industrial sensing and metrology solutions. The role encompasses system design from human-machine interface through data flow and analysis to hardware interfacing and control. No telecommuting No Agencies Please A minimum of five...

  • Backend Software Engineer Python

    1 week ago

    United Kingdom Techful Software Full time

    Are you a tech expert? We are looking for backend software engineers. Backend engineer help create web applications. They know how to build and create web applications using concepts like serverless, microservice architecture, and REST API. They know how to write end-to-end automated tests to make sure the software is performant and scalable. The backend...

  • Finance Transformation Data Architect

    4 weeks ago

    United Kingdom Ascent Software Full time

    Join Ascent and help us do extraordinary things for our customers! We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software...

  • Process Engineering

    4 weeks ago

    United Kingdom The Chemical Engineer Full time

    Our client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and engineering excellence. On the job training would be...

  • Software Engineer

    4 weeks ago

    United Kingdom Allen & Heath Limited Full time

    Department Research and Development Reporting to Software Manager To work within the research and development team producing / testing software for exciting new digital audio mixing products. Develop software to a high standard. Developing software features for new and existing products. Degree or HND in Computer Science / Software Engineering or...

  • AWS Cloud Data Architect

    3 weeks ago

    United Kingdom Sonata Software Full time

    Cloud Data Architect ( Azure/ GCP/ AWS) We have exciting opportunities for a Cloud Data Architect to join our Data & AI competency. We deliver scalable, business-critical and end-to-end solutions to our clients including Data & Cloud Strategy, Data Governance to Core Data Engineering, enabling them to transform & modernise their application & data platforms...

  • AWS Cloud Data Architect

    3 weeks ago

    United Kingdom Sonata Software Full time

    Cloud Data Architect ( Azure/ GCP/ AWS) We have exciting opportunities for a Cloud Data Architect to join our Data & AI competency. We deliver scalable, business-critical and end-to-end solutions to our clients including Data & Cloud Strategy, Data Governance to Core Data Engineering, enabling them to transform & modernise their application & data platforms...

  • Data Architect with Microsoft Purview

    4 weeks ago

    United Kingdom Ascent Software Full time

    Join Ascent and help us do extraordinary things for our customers! About us We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize...

  • Senior Engineer, Data Engineering

    4 weeks ago

    United Kingdom Data Science Talent Full time

    Data Engineering in Animal Health 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to...

  • Senior Data Consultant

    2 weeks ago

    United Kingdom Ascent Software Full time

    This is a perfect opportunity for ambitious individuals to join a team of curious minds and support peers with a passion and the skills for creating value for businesses using data. About Us We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and...

  • Lead Data Engineer-Data Management

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer-Data Management

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Cloud Data Architect- London

    3 weeks ago

    United Kingdom Sonata Software Full time

    Opening: Cloud Data Architect ( Azure/ GCP/ AWS) We have exciting opportunities for a Cloud Data Architect to join our Data & AI competency. We deliver scalable, business-critical and end-to-end solutions to our clients including Data & Cloud Strategy, Data Governance to Core Data Engineering, enabling them to transform & modernise their application & data...

  • Cloud Data Architect- London

    3 weeks ago

    United Kingdom Sonata Software Full time

    Opening: Cloud Data Architect ( Azure/ GCP/ AWS) We have exciting opportunities for a Cloud Data Architect to join our Data & AI competency. We deliver scalable, business-critical and end-to-end solutions to our clients including Data & Cloud Strategy, Data Governance to Core Data Engineering, enabling them to transform & modernise their application & data...

  • Data Integration Engineer

    4 weeks ago

    United Kingdom Abs Data Full time

    Big Data Integration Engineer Saint-Gobain Position description Are you someone who is passionate about data and transformation? At Saint-Gobain Digital, we are looking for a Big Data Integration Engineer to work remotely to create customer and business value as part of a digital transformation. This Data Engineer will be a part of our enthusiastic...

  • Proposals Process Engineer

    4 weeks ago

    United Kingdom The Chemical Engineer Full time

    West of London /M4 Process Systems £27-£42K PA Our client develops, engineers, fabricates, supplies, and installs discreet process equipment items and complete process systems for applications within chemical /process engineering. The company’s reputation is well established and founded on its commitment to product innovation, customer service and...

  • Senior Software Engineer

    5 days ago

    United Kingdom Nuclia Full time

    Nuclia is an easy-to-use & end-to-end API that lets developers build AI-powered search engines for unstructured data, with an open-source approach, backed by leading Deep Tech VCs and top business angel investors in the SaaS B2B sector. Nuclia software engineers develop the next generation of technologies to help developers build AI-powered tools for...

  • Senior Data Engineer

    3 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...

  • Senior Data Engineer

    4 weeks ago

    United Kingdom ON Data Staffing Full time

    Our client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks and exceptional communication skills to understand and...