Free GCP Data Engineer-Remote

Published date: January 27, 2023
  • Location: Oregon, United States

Role: GCP Data Engineer
Location: Remote

Job Description:

 

The Role:

 

Looking for an experienced Data Engineer who can help move on-prem Hadoop
workloads to Google

Cloud (GCP).

 

Responsibilities:

? Export data from the Hadoop ecosystem to ORC or Parquet file

? Build scripts to move data from on-prem to GCP

? Build Python/PySpark pipelines

? Transform the data as per the outlined data model

? Proactively improve pipeline performance and efficiency

 

?Must Have? Experience:

? 4+ years of Data Engineering work experience

? 2+ years of building Python/PySpark pipelines

? 2+ years working with Hadoop/Hive

? 4+ years of experiencing with SQL

? Experience with Data Warehousing & Data Lake

? Understanding of Data Modeling

? Google experience ? Cloud Storage, Cloud Composer, Dataproc & BigQuery

? Understanding of data files format like ORC, Parquet, Avro

 

?Nice to Have? Experience:

? Understanding of GCP services

? Experience using Cloud Warehouses like BigQuery (preferred), Amazon
Redshift, Snowflake

? etc.

? Working knowledge of Distributed file systems like GCS, S3, HDFS etc.

? Understanding of Airflow / Cloud Composer

? CI/CD and DevOps experience

? ETL tools e.g., Informatica (IICS) Ab Initio, Infoworks, Pentaho, SSIS


Reference : GCP Data Engineer-Remote jobs

Job details

Contact seller Share

Useful information

  • Avoid scams by acting locally or paying with PayPal
  • Never pay with Western Union, Moneygram or other anonymous payment services
  • Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
  • This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"

Related listings

  • RF Field Service Technician
    RF Field Service Technician
    Technology - (Oregon) - December 20, 2022 Free

    RESPONSIBILITIES Install, maintain and provide technical support and service of wireless communications equipment such as: UHF/VHF and 800/900 MHz analog and digital systems. Operating mobile, portable radio equipment, dispatch consoles, and microwav...

  • General Maintenance Mechanic
    General Maintenance Mechanic
    Technology - (Oregon) - December 4, 2022 Free

    Location: Eugene, OR Categories: Facilities/Grounds/Skilled Trades Department: Facilities Services Classification: General Maintenance Mechanic Appointment Type and Duration: Regular, Ongoing Salary: $20.62 - $26.00 per hour Review of Applications Be...

  • Business Analyst
    Business Analyst
    Technology - (Oregon) - November 30, 2022 Free

    Location: Portland, OR (Initial Remote)   Job Description:   5+ years of experience in business systems analysis and/or design, 2+ of which must be in the logistics domain. ·         Use strategic thinking to make recommendations that may not be wide...

Comments

    Leave your comment (spam and offensive messages will be removed)