AWS Data Architect
2 months ago
Melbourne, Derbyshire, United Kingdom
Hastha Solutions
Full time
About the RoleWe are seeking a highly skilled AWS Data Engineer to join our team at Hastha Solutions. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using AWS technologies such as AWS Glue, Airflow, Redshift, and Databricks.
Key Responsibilities- Data Ingestion and Processing: Design and implement data ingestion processes to collect and process large datasets from various sources.
- Data Pipelines: Develop and maintain data pipelines using AWS Glue, Airflow, and Databricks to ensure efficient data processing and storage.
- Data Modelling: Implement data modelling techniques to optimize data storage and retrieval processes.
- Database Administration: Design and maintain databases using SQL to ensure data integrity and security.
- Collaboration: Collaborate with data scientists and architects to develop and implement data-driven solutions.
- Communication: Communicate complex data analysis and results to stakeholders.
- Experience: Must have experience in analyzing and organizing raw data, designing and developing data pipelines using AWS technologies, and implementing data modelling techniques.
- Skills: Must have knowledge of Python, Pyspark, and SQL, as well as familiarity with code versioning using GIT and Jenkins.
- Certifications: Good to have AWS or Databricks associated certification.
- Communication Skills: Very good communication skills are essential for this role.
Australian/NZ Citizens/PR Holders are eligible to apply for this role.