Data Engineer

Hi ,

I hope you are doing well.

Please find the below job description for your review. If you are interested please reply back with your updated resume. Let me know the best time to talk with you.

Job Title: Data Engineer - Senior
Client: Visa
Location: Austin, TX
Duration: 6 Months

Description:

Responsibility level:

• Provide performance tuning and troubleshooting for existing ETL processes; Monitor production loads, conduct root cause analysis for all load failures, and quickly execute solutions to minimize down-time.
• Create logical and physical data models for new and existing projects

• Work with the Data Science team to deploy and optimize Python machine learning code running in Production environment
• Build and maintain highly scalable, performant and reliable systems and infrastructure.
  
  

Major Job Duties and Responsibilities:

• Candidate needs to have full Business Intelligence lifecycle experience: from requirements gathering (e.g. including data capture and processing, etc) to process design, BI deployment and monitoring performance for optimization.
• Experience managing a data warehouse including partnering with other workgroups globally that may supply and/or use data.
• In depth knowledge of data warehouse design. Big data experience (Hive, Presto, Airflow/Oozie, or other HDFS based) required. Will be dealing with datasets in the billions of rows and Terabytes of data and needs to have experience taking large amounts of data and narrowing them down to more focused data sets.
• Tableau experience is desired. Needs to know, or willing to learn, limitations of the tool and where DBs need to be leveraged vs Tableau.
• CRM experience preferred with ETL and data warehouse integration a huge plus. Experience with integrating CRM data with additional data sources for use in Business Intelligence tool a huge plus.
• Ideal candidate will have used statistical or logical analysis to identify system/account issues along with a process for using that data to impact change.
• Hands-on experience with Linux Bash Shell Scripting; Java; Python; Numpy/Pandas; Jupyter Notebook; SQL/Hive; JIRA; Bitbucket to store code; designing, executing and supporting ETL data validation process; and Data Warehousing.