Free GCP Data Engineer-Remote
- Location: Oregon, United States
Role: GCP Data Engineer
Location: Remote
Job Description:
The Role:
Looking for an experienced Data Engineer who can help move on-prem Hadoop
workloads to Google
Cloud (GCP).
Responsibilities:
? Export data from the Hadoop ecosystem to ORC or Parquet file
? Build scripts to move data from on-prem to GCP
? Build Python/PySpark pipelines
? Transform the data as per the outlined data model
? Proactively improve pipeline performance and efficiency
?Must Have? Experience:
? 4+ years of Data Engineering work experience
? 2+ years of building Python/PySpark pipelines
? 2+ years working with Hadoop/Hive
? 4+ years of experiencing with SQL
? Experience with Data Warehousing & Data Lake
? Understanding of Data Modeling
? Google experience ? Cloud Storage, Cloud Composer, Dataproc & BigQuery
? Understanding of data files format like ORC, Parquet, Avro
?Nice to Have? Experience:
? Understanding of GCP services
? Experience using Cloud Warehouses like BigQuery (preferred), Amazon
Redshift, Snowflake
? etc.
? Working knowledge of Distributed file systems like GCS, S3, HDFS etc.
? Understanding of Airflow / Cloud Composer
? CI/CD and DevOps experience
? ETL tools e.g., Informatica (IICS) Ab Initio, Infoworks, Pentaho, SSIS
Reference : GCP Data Engineer-Remote jobs
Job details
Useful information
- Avoid scams by acting locally or paying with PayPal
- Never pay with Western Union, Moneygram or other anonymous payment services
- Don't buy or sell outside of your country. Don't accept cashier cheques from outside your country
- This site is never involved in any transaction, and does not handle payments, shipping, guarantee transactions, provide escrow services, or offer "buyer protection" or "seller certification"
Related listings
-
RF Field Service TechnicianTechnology - (Oregon) - December 20, 2022 Free
RESPONSIBILITIES Install, maintain and provide technical support and service of wireless communications equipment such as: UHF/VHF and 800/900 MHz analog and digital systems. Operating mobile, portable radio equipment, dispatch consoles, and microwav...
-
General Maintenance MechanicTechnology - (Oregon) - December 4, 2022 Free
Location: Eugene, OR Categories: Facilities/Grounds/Skilled Trades Department: Facilities Services Classification: General Maintenance Mechanic Appointment Type and Duration: Regular, Ongoing Salary: $20.62 - $26.00 per hour Review of Applications Be...
-
Business AnalystTechnology - (Oregon) - November 30, 2022 Free
Location: Portland, OR (Initial Remote) Job Description: 5+ years of experience in business systems analysis and/or design, 2+ of which must be in the logistics domain. · Use strategic thinking to make recommendations that may not be wide...
Comments
Leave your comment (spam and offensive messages will be removed)