Data Engineer

2 days ago

Boston, Lincolnshire, United Kingdom Tech3pillars Technologies Full time

Job Title: Data Engineer

Location: Remote

Working Mode: Flexible

  • Education: Bachelor's degree in Computer Science or related field.
  • Experience: Minimum 6 years of hands-on experience in ETL/Big Data testing using Hadoop (Hive/Impala)/Spark SQL.
  • Key Skills: Proficient in writing complex Spark queries for HDFS/Parquet files validation, backend and frontend enterprise applications, SQL or PL/SQL using Oracle, Agile life cycle, Web UI testing and workflows, Tableau/Report testing.
  • Desirable Skills: Knowledge of AML/Financial crime, Python Automation, Databricks.
  • About Us: Tech3pillars Technologies is a leading technology company seeking a highly skilled Data Engineer to join our team.

Responsibilities:

  • Design, develop, and maintain large-scale data processing systems.
  • Develop and implement data pipelines using Hadoop, Spark, and other big data technologies.
  • Collaborate with cross-functional teams to identify and prioritize data engineering projects.
  • Ensure data quality, integrity, and security.
  • Stay up-to-date with emerging trends and technologies in data engineering.

Requirements:

  • Strong understanding of data engineering principles and practices.
  • Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
  • Proficient in programming languages such as Java, Python, and Scala.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

  • Data Protection Engineer

    3 weeks ago

    Boston, Lincolnshire, United Kingdom SoftPathTechnologies Full time

    SoftPath Technologies is seeking a skilled and dedicated Storage Backup Engineer to join our growing team. In this role, you will play a vital part in ensuring the security and integrity of our critical data assets. As a Storage Backup Engineer, your primary responsibility will be to design, implement, and maintain robust backup and recovery solutions for...

  • Program Data Analyst/BI Engineer

    2 days ago

    Boston, Lincolnshire, United Kingdom Chelsoft Solutions Co Full time

    Job Description**About the Role**Chelsoft Solutions Co is seeking a highly skilled Program Data Analyst/BI Engineer to join our team. As a key member of our data analytics team, you will be responsible for designing, developing, and deploying business analytics dashboards using PowerBI.Key Responsibilities:Design and develop business analytics dashboards...

  • Program Data Analyst/BI Engineer

    2 days ago

    Boston, Lincolnshire, United Kingdom Chelsoft Solutions Co Full time

    Job Description**About the Role**Chelsoft Solutions Co is seeking a highly skilled Program Data Analyst/BI Engineer to join our team. As a key member of our data analytics team, you will be responsible for designing, developing, and deploying business analytics dashboards using PowerBI.Key Responsibilities:Design and develop business analytics dashboards...

  • Program Data Analyst/BI Engineer

    2 days ago

    Boston, Lincolnshire, United Kingdom Chelsoft Solutions Co Full time

    Job Description**About the Role**Chelsoft Solutions Co is seeking a highly skilled Program Data Analyst/BI Engineer to join our team. As a key member of our data analytics team, you will be responsible for designing, developing, and deploying business analytics dashboards using PowerBI.Key Responsibilities:Design and develop business analytics dashboards...

  • Program Data Analyst/BI Engineer

    2 days ago

    Boston, Lincolnshire, United Kingdom Chelsoft Solutions Co Full time

    Job Description**About the Role**Chelsoft Solutions Co is seeking a highly skilled Program Data Analyst/BI Engineer to join our team. As a key member of our data analytics team, you will be responsible for designing, developing, and deploying business analytics dashboards using PowerBI.Key Responsibilities:Design and develop business analytics dashboards...

  • Lead Data Architect

    1 day ago

    Boston, Lincolnshire, United Kingdom DcTek Inc Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at DcTek Inc. as a key member of our Data Engineering department.Key ResponsibilitiesDesign and implement large-scale data warehousing solutions using Snowflake cloud data warehouse and AWS S3.Develop and maintain complex SQL scripts using statistical aggregate functions and...

  • Lead Data Architect

    1 day ago

    Boston, Lincolnshire, United Kingdom DcTek Inc Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at DcTek Inc. as a key member of our Data Engineering department.Key ResponsibilitiesDesign and implement large-scale data warehousing solutions using Snowflake cloud data warehouse and AWS S3.Develop and maintain complex SQL scripts using statistical aggregate functions and...

  • Data Warehouse Engineer

    3 weeks ago

    Boston, Lincolnshire, United Kingdom Zenith services Full time

    Zenith Services is seeking a skilled Data Warehouse Specialist to join our growing team. In this role, you will play a vital part in ensuring the accuracy and reliability of our software products by developing Azure-based applications, data warehouses, and ETL backend systems.Responsibilities:Design, develop, and maintain Snowflake objects, views,...

  • Data Warehouse Engineer

    6 days ago

    Boston, Lincolnshire, United Kingdom Zenith services Full time

    Zenith Services is seeking a skilled Data Warehouse Specialist to join our growing team. In this role, you will play a vital part in ensuring the accuracy and reliability of our software products by developing Azure-based applications, data warehouses, and ETL backend systems.Responsibilities:Design, develop, and maintain Snowflake objects, views,...

  • Cloud Data Architect

    6 days ago

    Boston, Lincolnshire, United Kingdom SmartIPlace Full time

    Job DescriptionRole: Data Solution ArchitectLocation: Boston, MADuration: 12 Months ContractVisa: USC, GC, EAD, GC, H4Interviews: VideoNote:Please read all the requirements carefully. This role has been out for a bit, but we are looking for the right candidate. We are seeking a strong fit for this position.This is for BCBS of Mass (BCBSMA). We are looking...

  • Data Solution Architect

    6 days ago

    Boston, Lincolnshire, United Kingdom SmartIPlace Full time

    Job DescriptionRole: Data Solution ArchitectLocation: Boston, MADuration: 12 Months ContractVisa: USC, GC, EAD, GC, H4Interviews: VideoNote:Please read all the requirements carefully. This role has been out for a bit, but we are looking for the right candidate. We are seeking a strong fit for this position.This is for BCBS of Mass (BCBSMA). We are looking...

  • Data Solution Architect

    7 days ago

    Boston, Lincolnshire, United Kingdom SmartIPlace Full time

    Job DescriptionRole: Data Solution ArchitectLocation: Boston, MADuration: 12 Months ContractVisa: USC, GC, EAD, GC, H4Interviews: VideoNote:Please read all the requirements carefully. This role has been out for a bit, but we are looking for the right candidate. We are seeking a strong fit for this position.This is for BCBS of Mass (BCBSMA). We are looking...

  • Cloud Data Architect

    7 days ago

    Boston, Lincolnshire, United Kingdom SmartIPlace Full time

    Job DescriptionRole: Data Solution ArchitectLocation: Boston, MADuration: 12 Months ContractVisa: USC, GC, EAD, GC, H4Interviews: VideoNote:Please read all the requirements carefully. This role has been out for a bit, but we are looking for the right candidate. We are seeking a strong fit for this position.This is for BCBS of Mass (BCBSMA). We are looking...

  • Data Engineer

    6 days ago

    Boston, Lincolnshire, United Kingdom Tekishub Consulting Services Full time

    About the RoleWe are seeking a highly skilled Big Data Testing Specialist to join our team at Tekishub Consulting Services.Key Responsibilities:Design and implement comprehensive testing strategies for Big Data solutions using Hadoop and Spark.Develop and execute test plans, cases, and scripts to ensure data integrity and quality.Collaborate with...

  • Data Engineer

    7 days ago

    Boston, Lincolnshire, United Kingdom Tekishub Consulting Services Full time

    About the RoleWe are seeking a highly skilled Big Data Testing Specialist to join our team at Tekishub Consulting Services.Key Responsibilities:Design and implement comprehensive testing strategies for Big Data solutions using Hadoop and Spark.Develop and execute test plans, cases, and scripts to ensure data integrity and quality.Collaborate with...

  • Data Architect

    3 weeks ago

    Boston, Lincolnshire, United Kingdom SmartIPlace Full time

    SmartIPlace is seeking a highly skilled and experienced Data Solution Architect to join our growing team. In this role, you will play a pivotal part in designing, developing, and implementing innovative data solutions that drive business value. As a Data Solution Architect, you will be responsible for architecting and delivering end-to-end data solutions...

  • Data Solution Architect

    2 days ago

    Boston, Lincolnshire, United Kingdom SmartIPlace Full time

    Job DescriptionRole: Data Solution ArchitectLocation: Boston, MA (Hybrid role, on-site and remote work options)Duration: 12-month contractVisa: USC, GC, EAD, GC, H4Interviews: Video interviewsNote:Please read all the requirements carefully. This role is ideal for a strong Data Solution Architect with experience in cloud data platforms, particularly AWS. The...

  • Data Solution Architect

    2 days ago

    Boston, Lincolnshire, United Kingdom SmartIPlace Full time

    Job DescriptionRole: Data Solution ArchitectLocation: Boston, MA (Hybrid role, on-site and remote work options)Duration: 12-month contractVisa: USC, GC, EAD, GC, H4Interviews: Video interviewsNote:Please read all the requirements carefully. This role is ideal for a strong Data Solution Architect with experience in cloud data platforms, particularly AWS. The...

  • Big Data Quality Assurance Engineer

    3 weeks ago

    Boston, Lincolnshire, United Kingdom Tekishub Consulting Services Full time

    Tekishub Consulting Services is seeking a skilled Big Data Testing Specialist to join our growing team. In this role, you will play a crucial part in ensuring the quality and reliability of our big data systems. As a Big Data Testing Specialist, you will be responsible for designing, developing, and executing comprehensive test plans for our Hadoop-based...

  • Big Data Quality Assurance Engineer

    6 days ago

    Boston, Lincolnshire, United Kingdom Tekishub Consulting Services Full time

    Tekishub Consulting Services is seeking a skilled Big Data Testing Specialist to join our growing team. In this role, you will play a crucial part in ensuring the quality and reliability of our big data systems. As a Big Data Testing Specialist, you will be responsible for designing, developing, and executing comprehensive test plans for our Hadoop-based...