Data Engineer Job at People Tech Group Inc, Washington DC

YjVmUGtPdWp3WVVHNzZnSmxNSTlUREhJTEE9PQ==
  • People Tech Group Inc
  • Washington DC

Job Description

Role: Data Engineer

Duration: Long-term project.

Location: Redmond WA

Key Skills

  • Apache Spark (PySpark or Scala) : Writing scalable distributed rule engines.
  • Apache Hive : Querying partitioned datasets, schema handling.
  • Amazon EMR : Cluster management, tuning jobs for large datasets (20+ TB).
  • AWS S3 : Data partitioning, object lifecycle, access patterns.
  • Glue Data Catalog : Managing Hive table metadata.
  • Data Quality Frameworks : (Great Expectations, Deequ, or custom rules).
  • CI/CD : Code deployment pipelines (Git, Jenkins, Airflow, etc

Job Tags

Similar Jobs

Introlinx

Senior Data Analyst Job at Introlinx

 ...Extensive hands-on experience with Snowflake , including writing complex queries and optimizing performance Fixed Income Snowflake Data Analyst Contract (U.S. Citizens / Green Card Holders Only) Introlinx is seeking a Data Analyst with strong Snowflake... 

Hidden Gems ABA

Behavior Technician Job at Hidden Gems ABA

Hidden Gems ABA is a growing ABA therapy company. We are looking for part or full-time RBTs with strong skills, experience, and passion for helping children with autism spectrum disorder using ABA principles. At Hidden Gems ABA we care deeply about each child. We work...

Insight Global

Welder Job at Insight Global

Our client is looking for a welder to be responsible for various types of weld preparation, welding, and weld finishing operations to accomplish welding IAW customer drawings, specifications. Youll perform welding tasks based on customer blueprints and specifications...

Warner Bros. Discovery

Director, Security Job at Warner Bros. Discovery

 ...explore and grow into your best selves. Here you are supported, here you are celebrated, here you can thrive. Your Role The Security Director is a dynamic leader responsible for ensuring the safety, security, and operational integrity of the organization. This role... 

Integrated Resources, Inc ( IRI )

Laboratory Technician Job at Integrated Resources, Inc ( IRI )

 ...Title: Lab Technician (Anatomic and Investigative Pathology (AIP)) Location: Groton, CT Duration: 12+ Months Work Schedule: Monday Friday / First shift Position Summary: The AIP technician is responsible for performing accurate, high-quality necropsy...