Data Engineer Job at People Tech Group Inc, Washington DC

QVlsNjVNOGNBUVJieWswcUVvdWhIWkFhUmc9PQ==
  • People Tech Group Inc
  • Washington DC

Job Description

Role: Data Engineer

Duration: Long-term project.

Location: Redmond WA

Key Skills

  • Apache Spark (PySpark or Scala) : Writing scalable distributed rule engines.
  • Apache Hive : Querying partitioned datasets, schema handling.
  • Amazon EMR : Cluster management, tuning jobs for large datasets (20+ TB).
  • AWS S3 : Data partitioning, object lifecycle, access patterns.
  • Glue Data Catalog : Managing Hive table metadata.
  • Data Quality Frameworks : (Great Expectations, Deequ, or custom rules).
  • CI/CD : Code deployment pipelines (Git, Jenkins, Airflow, etc

Job Tags

Similar Jobs

AECOM

US Advisor Attorney-Vice President, Assistant General Counsel Job at AECOM

Are you an experienced attorney with a passion for investment management? Join our dynamic team at JPMorgan Asset Management, where you'll...  ...strategic thinking, and collaboration. Elevate your career with us and make a significant impact in the financial industry.As an... 

24 Seven Talent

Graphic Designer, Email Experience Job at 24 Seven Talent

 ...Our client, a Top Retailer, is looking for an Email Designer to join their team. This will be 30-40 hours per week with potential to convert to full time! Responsibilities Translate creative briefs and copy documents into visually compelling email designs Update... 

Square Enix America

Operations Support, Night Agent Job at Square Enix America

 ...account information and network information. Must be able to work non-traditional hours (typically 8 pm to 5 am and including weekends...  ...20 pounds. This expectation holds true for the current work-from-home environment. Benefits Annual Salary:$28.00 per hour... 

NORY, Inc.

Summer Operations Internship (Paid): Education Startup, NYC Job at NORY, Inc.

 ...ly/noryi LinkedIn: bit.ly/norylink Summer Camp Video: bit.ly/noryvideo1 We are looking for a rock-star Summer Operations Intern: This is a unique opportunity for an ambitious, entrepreneurial individual to gain hands-on experience and grow in a mission-driven... 

HydroJug

Senior Supply Chain Analyst Job at HydroJug

Company Overview: HydroJug is a dynamic and rapidly growing company in the drinkware sector. We are currently seeking an experienced E-commerce Marketplace Manager & Operations Analyst to oversee and optimize our operations on both Walmart and Amazon platforms...