Lead Data Engineer Job at WorkHQ, Los Angeles, CA

L29sMkk4b1pZK0ZrSW9lMDRaanFjejh3UlE9PQ==
  • WorkHQ
  • Los Angeles, CA

Job Description

Company Context

Series A, well-funded US startup in HRTech developing WorkHQ.com and an AI Recruiter product.

This is a US-only, Remote role (Mainland).

Role Overview

Lead data infrastructure architect managing billions of data points across 250M+ professional profiles.

Hire data engineers to aid you in that journey.

Core Responsibilities

  • Design scalable data pipelines processing massive record volumes

  • Architect ETL processes using PySpark on Amazon EMR (Open to shifting to other solutions like Data Bricks / Snowflake)

  • Distribute enriched data through medallion architecture across Postgres, Athena, OpenSearch

  • Integrate new data sources into the main pipeline

  • Implement advanced data matching using Splink

Technical Requirements

  • 5-8 years professional data engineering experience

  • Good proficiency in:

    • PySpark and distributed computing

    • AWS data services (EMR, Glue, Athena)

    • Docker

    • Pandas and DataFrame manipulation

    • Complex data format handling (JSONL, Parquet)

  • Strong background in:

    • Big data processing architectures

    • Data warehouse design

    • Performance optimization

  • Advanced Python, SQL skills

Nice to Have

  • Probabilistic record linking expertise

  • OpenSearch/elasticsearch technologies

  • Machine learning data pipeline design

  • Recruitment tech ecosystem knowledge

Technical Stack

  • Big Data: PySpark, EMR

  • Databases: Postgres, OpenSearch

  • Cloud: AWS

  • Containerization: Docker

  • Data Formats: JSONL, Parquet

  • Analytics: Metabase, Athena, Glue

  • Data Processing: Pandas, Splink

Other Considerations

While this role has specific requirements - if you lack a few technical skills, but motivated to learn and lead the platform, please apply for consideration.

If you are coming from Director/Head of/VP levels that is relevant to this job, you can apply as well.

You will need to apply directly on our platform.

Thank you for your time.

Job Tags

Permanent employment, Remote work, Shift work,

Similar Jobs

Truluck’s Ocean’s Finest Seafood & Crab

Executive Sous Chef ( {{city}}) Job at Truluck’s Ocean’s Finest Seafood & Crab

 ...Trulucks is looking for an Executive Sous Chef to join our culinary team in The Woodlands, Texas! Salary: $75-$85k (Salary commensurate to experience and position hired for) Bonus Potential (Paid Quarterly) Full-Time Great Benefits 401(k) matching (4... 

Mondo

Data Governance Resource Job at Mondo

 ...Title: Data Governance Resource Location: 100% REMOTE Start Date: ASAP Duration: 1 year contract Hours: 40 hours/week (any US time zone) Compensation Range: $55 - $60/hour W2 Job Description Data Governance Analyst We're looking for a hands-on... 

PetSitter.com

Pet Sitter Wanted - Minneapolis, Minnesota Pet Trainer Opportunity Job at PetSitter.com

I hope you are having a good day. My family is looking for talented pet care in Minneapolis. Please let me know if you are interested.Please visit to view full details and to apply. Lots of jobs to choose from!

University Health

Student Nurse Intern PRN Job at University Health

 ...implementing the plan of care. Delegates patient care activities to ancillary staff as appropriate and accepts mentoring from experienced nursing staff. EDUCATION/EXPERIENCE Junior semester or senior semester of nursing school in an accredited baccalaureate program. Must... 

Las Vegas Petroleum

Dunkin Overnight Baker Job at Las Vegas Petroleum

 ...travel center industry, is looking for an energetic and dedicated Dunkin Overnight Baker to join our team. In this role, you will be...  ...Key Responsibilities: Bake a variety of items, including donuts, muffins, and other pastries, following Dunkin recipes and quality...