Job Title: GCP Data Engineer
Location: Remote –
EAST COAST
Duration:Full-time
Job Description:
- Work closely with data scientists, data architects,
business analysts, and other disciplines to understand data requirements
and deliver accurate data solutions.
- Analyze
and document existing data system processes to identify opportunities for
improvement.
- Develop
detailed process maps that describe data flow and integration across
multiple systems.
- Create
a catalog of data fields and data structures across various databases and
systems.
- Compare
data fields and structures to identify inconsistencies and discrepancies
- Contribute
towards gap analysis and recommend solutions for standardizing data fields
and structures.
- Recommend
data directories to organize and manage data assets effectively.
- Propose
data standards and best practices.
Technical skills
- Proven experience (5+ years) in data engineering.
- Proficiency
in database management systems (e.g., SQL, NoSQL databases).
- Experience
with data warehousing and ETL (Extract, Transform, Load) processes.
- Hands-on
experience working with cloud data platforms, with a strong preference for
Google Cloud Platform (GCP) tools like Big Query, Cloud Functions, and
Dataproc.
- Skilled
in Python programming with working knowledge of Pyspark.
- Experience
developing ELT processes within a medallion architecture (Bronze, Silver,
Gold layers).
- Skilled
in designing robust data validation and transformation processes to
support downstream BI and analytics tools.
- Knowledge
of data modeling, data architecture, and data integration techniques.
Analytical skills
- Strong problem-solving skills with attention to detail.
- Experience
in process mapping and optimization.
- Understanding
of data governance frameworks and practices.
- Excellent
verbal/written communication and presentation skills, with the ability to
successfully articulate your work and its intent to your team and your
client
- A unique point of view. You are trusted to question
approaches, processes, and strategy to better serve your team.
