Press ENTER to skip to the job description.
Sr. Data Engineer

Sr. Data Engineer
CA, San Francisco

Job Description

Client is looking for a Senior Data Engineer that will contribute in all aspects of creating an analytical data driven environment. The core data engineering team is responsible for the building out the data pipeline, gathering internal and external data, generating metrics, managing and monitoring batch and streaming jobs, and implementing analytical tools to drive strategic decision making.


Responsibilities

Evangelize Modern Big Data Practices

Design warehouse schemas that accurately represent our business, and facilitate analysis and building of reports

Help build batch and streaming data ingestion pipeline using Hadoop, Hive, Pig, Storm, and Kafka Streams

Write ETL jobs to transform raw data into business information to drive decision making

Develop analytical environment using internal and external reporting tools

Integrate internal and external data with warehouse and external tools


Experience

Excellent technical skills including expert knowledge of the Hadoop ecosystem

Experience of the analysis, design and development of Data Warehouse and Big Data solutions, including analyzing source systems, developing ETL design patterns and templates, ETL development, data profiling and data quality issues resolution.

Experience of team and technical leadership

Excellent communication skills and presentation skills

Expert Level experience of the The Hadoop System

Strong SQL, Java, and Python skills

Database (relational & NoSQL), Data Warehouse knowledge

Stream processing experience (Storm, Kafka Streams)

Passion and enthusiasm for learning new technologies and technique

Comfortable with Linux


Apply Now