ArchitectureDesignDevelopment - Big Data ArchitectII

Job Description: Job Location: Portland OR(Onsite)
Contractor Bill rate:BRBR

Responsibilities:
(The primarytasks functions and deliverables of the role)
Design andbuild reusable components frameworks and libraries at scale tosupport analytics products
Design and implement productfeatures in collaboration with business and Technology stakeholders
Identify and solve issues concerning data management toimprove data quality
Clean prepare and optimize data foringestion and consumption
Collaborate on theimplementation of new data management projects and restructure ofthe current data architecture
Implement automatedworkflows and routines using workflow scheduling tools
Build continuous integration testdriven development and productiondeployment frameworks
Analyze and profile data fordesigning scalable solutions
Troubleshoot data issuesand perform root cause analysis to proactively resolve product andoperational issues

Requirements:

Experience:
Strong understanding of datastructures and algorithms
Strong understanding ofsolution and technical design
Has a strong problemsolving and analytical mindset.
Able to influence andcommunicate effectively both verbally and written with team membersand business stakeholders
Able to quickly pick up newprogramming languages technologies and frameworks
Experience building cloud scalable real time and highperformancedata lake solutions
Fair understanding of developingcomplex data solutions
Experience working on endtoendsolution design
Willing to learn new skills andtechnologies
Has a passion for data solutions

Required and Preferred Skill Sets:
Hands on experience in Databricks and AWS EMR Hive Pyspark S3Athena.
Familiarity with Spark StructuredStreaming
Minimum 4 years experience working experiencewith Hadoop stack dealing huge volumes of data in a scalablefashion
10 years of handson experience with SQL ETL datatransformation and analytics functions
8 years of handsonPython experience including Batch scripting data manipulationdistributable packages
4 years experience working withbatch orchestration tools such as Apache Airflow or equivalentpreferable Airflow
4 years working with code versioningtools such as GitHub or BitBucket; expert level understanding ofrepo design and best practices
Familiarity withdeployment automation tools such as Jenkins
8 years ofhandson experience designing and building ETL pipelines; expertwith data ingest change data capture data quality; hand onexperience with API development
4 years designing anddeveloping relational database objects; knowledgeable on logicaland physical data modelling concepts; some experience withSnowflake
Familiarity with Tableau or Cognos usecases
Familiarity with Agile; working experiencepreferred
Additional Sills: Skills: Category Name Required Importance Experience No items to display.

---