Data Engineer - Snowflake and Databricks Job at Expedite Technology Solutions, Seattle, WA

K1lCOExzd1lZT2hwTElPMTU1TGhkejgxU2c9PQ==
  • Expedite Technology Solutions
  • Seattle, WA

Job Description

Primary Skill: DBT Labs Snowflake Secondary Skill: Databricks Databricks Unity Catalog Responsibilities: Develop, optimize, and maintain data pipelines using Azure Data Factory (ADF), DBT Labs, Snowflake, and Databricks. Develop reusable jobs and configuration-based integration framework to optimize development and scalability. Manage data ingestion for structured and unstructured data (landing/lake house: ADLS, Sources: ADLS, Salesforce, SharePoint Documents Libraries, Partner Data: Client, IHME, WASDE, etc.). Implement and optimize ELT processes, source-to-target mapping, and transformation logic in DBT Labs, Azure Data Factory, Databricks Notebook, Snow SQL, etc. Collaborate with data scientists, analysts, data engineers, report developers, and infrastructure engineers for end-to-end support. Co-develop CI/CD best practices, automation, and pipelines with Infrastructure engineers for code deployments using GitHub Actions. Bring in automation from source-to-target mappings to data pipelines and data lineage in Collibra. Required Experience: Hands-on experience building pipelines with ADF, Snowflake, Databricks, and DBT Labs. Expertise in Azure Cloud with Databricks, Snowflake, and ADLS Gen2 integration. Data Warehousing and Lakehouse Knowledge: Proficient with ELT processes, *** Tables, and External Tables for structured/unstructured data. Experience with Databricks Unity Catalog and data sharing technologies. Strong skills in CI/CD (Azure DevOps, GitHub Actions) and version control (GitHub). Strong cross-functional collaboration and technical support experience for data scientists, report developers, and analysts. #J-18808-Ljbffr Expedite Technology Solutions

Job Tags

Similar Jobs

Coastal

Truck Jockey Job at Coastal

$18.00 Starting base pay rate. Job Summary: Responsible for backing trucks to the dock at the appropriate doors while ensuring that the truck is functioning properly to perform the route, and performing other duties as assigned by Supervisor or Manager. RESPONSIBILITIES...

Caring for Family of Companies

Private In-Home Caregiver Job at Caring for Family of Companies

 ..., a competitive pay range of $18-$22/hr. Hear it from us in just 2 minutes how were raising the bar for our amazing in home Caregivers at: Ready to make an impact? EZ-APPLY NOW! Our Culture: At Caring for Family of Companies , our Caregivers are the... 

Culver's

Crew Member - 14 & 15 year old Job at Culver's

This job is for 14 and 15 year olds Culver's - Immediate Crew Member - 14 & 15 year old Are...  ...Career advancement opportunities Paid time off and insurance benefits for eligible...  ...Janesville, WI 53545 Apply now to be a part of our fun and loving team at Culver's!... 

Big Easy Recruiting

Class A CDL Truck Driver - Almost Local - 1400-1580 USD Weekly Job Job at Big Easy Recruiting

Class A CDL Truck Driver - Almost Local - 1400-1580 USD Weekly JobHiring experienced CDL-A drivers in our Dedicated Account. Drivers pull no-touch Reefer freight, and are home multiple nights per week, in addition to their 34 hr resetCall Chris anytime at (314) 270... 

Nightingale Nurses - Allied

Travel Pathology Assistant Job at Nightingale Nurses - Allied

 ...Job Description Nightingale Nurses - Allied is seeking a travel Pathology Assistant for a travel job in Boston, Massachusetts. Job Description & Requirements ~ Specialty: Pathology Assistant ~ Discipline: Allied Health Professional ~ Start Date: 07/28/202...