Data Engineer - Remote Job at Staffing the Universe, United States

  • Staffing the Universe
  • United States

Job Description

Data Engineer

Job Location: SFO, CA (Remote)

Contract Client: Airbnb

Rate: Depend on Experience

Job Authorization: US Citizen/ GC /EAD (H4/L2/TN) preferred C2c are open only for own corp not from any employers

Responsibilities:
  • Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive Airbnb business growth and improve the product experience.
  • Build scalable Spark data pipelines leveraging Airflow scheduler/executor framework
Minimum Requirements:
  • 8+ years of relevant industry experience
  • Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
  • Working knowledge of relational databases and query authoring (SQL).
  • Good communication skills, both written and verbal
  • Strong experience using ETL framework (ex: Airflow, Flume, Oozie etc.) to build and deploy production-quality ETL pipelines.
  • Experience building batch data pipelines in Spark Scala.
  • Strong understanding of distributed storage and compute (S3, Hive, Spark)
  • General software engineering skills (Java or Python, Github)

Job Tags

Contract work

Similar Jobs

Amentum

Firefighter Job at Amentum

 ...Firefighter Amentum is seeking a Firefighter to join our team in Hawthorne, Nevada to support the Hawthorne Army Depot. The Firefighter will serve on an ambulance, engine, or truck at one of two different fire stations at HWAD ensure the safety and security of personnel... 

European Wax Center - Ann Arbor, MI

Cosmetologist or Esthetician Job at European Wax Center - Ann Arbor, MI

 ...Job Description Job Description As a Wax Specialist, youll help guests feel beautiful and comfortable by providing excellent body waxing services using our Exclusive Comfort Wax and products. Our centers offer an upbeat, professional, and team-driven environment where... 

Nexon America

Localization Copy Editor Job at Nexon America

 ...passionate individuals who want to learn, play, and grow with us. Ready for a new challenge?Summary Of PositionThe Localization Copy Editor is responsible for writing and editing in-game text and voiceover scripts for all Nexon games. They are also responsible for... 

HCA Mission Hospital - Memorial Campus

Trauma Medical Director Job at HCA Mission Hospital - Memorial Campus

 ...Florida State verified level II Trauma Center High volume of blunt / penetrating trauma (87% / 13%) Pediatric trauma (under 16 years old) and all burn cases stabilized and transferred to pediatric center Incentive/Benefits Package: Employment and academic... 

Benz Technology Inc.

Cloud DevOps Engineer Job at Benz Technology Inc.

 ...and implementation of a DevOps platform on AWS to support the migration of COTS products from on-premises environments to the cloud. The engineer will establish infrastructure standards, build CI/CD pipelines, and define best practices adopted across both infrastructure...