Big Data Systems Engineer

20 hours ago

London, Greater London, United Kingdom iO Associates - UKEU Full time
Job Title: Data Engineer/Inżynier Big Data

We are seeking an experienced Data Engineer to join our team at iO Associates - UK/EU. As a key member of our team, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.

Key Responsibilities:
  • Design and implement scalable big data systems that meet the needs of our data science, machine learning, and AI workloads.
  • Work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations.
  • Develop and maintain data pipelines and orchestration processes using tools like NiFi and Airflow.
  • Collaborate with data scientists and engineers to ensure the effective use of big data systems and tools.
  • Stay up-to-date with the latest big data technologies and trends, and make recommendations for their adoption and implementation.
Requirements:
  • Proven experience in scripting languages such as Python, Bash, or similar.
  • Experience with integration testing and ensuring seamless tool integration.
  • In-depth knowledge of Linux internals and system administration.
  • Hands-on experience with data pipeline tools like NiFi and Airflow.
  • Proven ability to design scalable big data systems with a focus on security and GDPR compliance.
  • Hybrid cloud experience, specifically with on-premise and AWS cloud environments.
  • Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.
  • Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.
  • Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.
  • Certification in AWS or other cloud platforms.
  • Experience with additional data orchestration tools.
What We Offer:

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced Data Engineer looking for a new challenge, please submit your application.

  • Big Data Systems Engineer

    1 week ago

    London, Greater London, United Kingdom Northrop Grumman Full time

    About the RoleWe are seeking a highly skilled Big Data Systems Engineer to join our team at Northrop Grumman UK. As a key member of our Cyber & Intelligence business, you will play a critical role in designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key ResponsibilitiesDesign...

  • Big Data Systems Engineer

    1 week ago

    London, Greater London, United Kingdom Northrop Grumman Full time

    About the RoleWe are seeking a highly skilled Big Data Systems Engineer to join our team at Northrop Grumman UK. As a key member of our Cyber & Intelligence business, you will play a critical role in designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key ResponsibilitiesDesign...

  • Big Data Systems Engineer

    2 days ago

    London, Greater London, United Kingdom Northrop Grumman Full time

    About the RoleWe are seeking a highly skilled Big Data Systems Engineer to join our team at Northrop Grumman UK. As a key member of our Cyber & Intelligence business, you will play a critical role in designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key ResponsibilitiesDesign...

  • Big Data Systems Engineer

    2 days ago

    London, Greater London, United Kingdom Northrop Grumman Full time

    About the RoleWe are seeking a highly skilled Big Data Systems Engineer to join our team at Northrop Grumman UK. As a key member of our Cyber & Intelligence business, you will play a critical role in designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key ResponsibilitiesDesign...

  • Big Data Engineer

    14 hours ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data processing pipelines using Hadoop, Spark, and other Big Data technologies.Develop and...

  • Big Data Engineer

    18 hours ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data processing pipelines using Hadoop, Spark, and other Big Data technologies.Develop and...

  • Big Data Engineer

    2 days ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Hadoop, Spark, and other Big Data technologies.Develop and maintain...

  • Big Data Engineer

    2 days ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Hadoop, Spark, and other Big Data technologies.Develop and maintain...

  • Big Data Engineer

    1 week ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Hadoop, Spark, and NoSQL databases.Develop and implement data...

  • Big Data Engineer

    1 week ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Hadoop, Spark, and NoSQL databases.Develop and implement data...

  • Big Data Systems Architect

    2 weeks ago

    London, Greater London, United Kingdom Northrop Grumman Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team at Northrop Grumman UK. As a key member of our Cyber & Intelligence business, you will play a critical role in designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key...

  • Big Data Systems Architect

    2 weeks ago

    London, Greater London, United Kingdom Northrop Grumman Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team at Northrop Grumman UK. As a key member of our Cyber & Intelligence business, you will play a critical role in designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key...

  • Data Engineer/Inżynier Big Data

    2 days ago

    London, Greater London, United Kingdom iO Associates - UKEU Full time

    Big Data Engineer Job DescriptionWe are seeking an experienced Big Data Engineer to join our team at iO Associates - UK/EU. As a key member of our team, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key Responsibilities:Design and implement...

  • Data Engineer/Inżynier Big Data

    2 days ago

    London, Greater London, United Kingdom iO Associates - UKEU Full time

    Big Data Engineer Job DescriptionWe are seeking an experienced Big Data Engineer to join our team at iO Associates - UK/EU. As a key member of our team, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads.Key Responsibilities:Design and implement...

  • Big Data Engineer

    5 days ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team of experts in delivering top-tier Big Data solutions to companies across various sectors.Key ResponsibilitiesDesign and develop scalable Big Data architectures using Hadoop, Spark, and NoSQL databases.Implement data processing pipelines using Apache Flink and Apache Storm.Work...

  • Big Data Engineer

    5 days ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team of experts in delivering top-tier Big Data solutions to companies across various sectors.Key ResponsibilitiesDesign and develop scalable Big Data architectures using Hadoop, Spark, and NoSQL databases.Implement data processing pipelines using Apache Flink and Apache Storm.Work...

  • Big Data Engineer

    6 days ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team of experts in delivering top-tier Big Data solutions to companies across various sectors.Key ResponsibilitiesDesign and develop scalable Big Data architectures using Hadoop, Spark, and NoSQL databases.Implement data processing pipelines using Apache Flink and Apache Storm.Work...

  • Big Data Engineer

    6 days ago

    London, Greater London, United Kingdom Information Tech Consultants Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team of experts in delivering top-tier Big Data solutions to companies across various sectors.Key ResponsibilitiesDesign and develop scalable Big Data architectures using Hadoop, Spark, and NoSQL databases.Implement data processing pipelines using Apache Flink and Apache Storm.Work...

  • Big Data Engineer

    1 week ago

    London, Greater London, United Kingdom Hunter Bond Full time £100,000

    Job Title: Big Data EngineerAt Hunter Bond, we are seeking a highly skilled Big Data Engineer to join our team in London. As a key member of our engineering team, you will be responsible for designing and developing end-to-end solutions for our datalake initiatives.Key Responsibilities:Provide technical expertise in designing and developing solutions for our...

  • Big Data Engineer

    1 week ago

    London, Greater London, United Kingdom Hunter Bond Full time £100,000

    Job Title: Big Data EngineerAt Hunter Bond, we are seeking a highly skilled Big Data Engineer to join our team in London. As a key member of our engineering team, you will be responsible for designing and developing end-to-end solutions for our datalake initiatives.Key Responsibilities:Provide technical expertise in designing and developing solutions for our...