[Remote] Data Engineer – Google Cloud Platform
Note: The job is a remote job and is open to candidates in USA. Dice is seeking a highly skilled Data Engineer with deep expertise in Google Cloud Platform and modern data architecture. The ideal candidate will design and develop scalable data pipelines, implement Medallion Architecture, and develop enterprise-grade solutions using BigQuery, PySpark, Dataflow, Airflow, and Java.ResponsibilitiesDesign and develop scalable batch and real-time data pipelines on Google Cloud PlatformImplement Medallion Architecture (Bronze, Silver, Gold layers)Build high-performance data transformations using Python, PySpark, and JavaDevelop and optimize complex SQL queries for analytics workloadsWork extensively with BigQuery for large-scale data processing and optimizationDevelop and deploy pipelines using Cloud DataflowOrchestrate workflows using Cloud Composer (Apache Airflow)Manage storage and lifecycle using Google Cloud Storage (GCS)Implement CI/CD pipelines and version control practicesEnsure governance, security, and access control using Google Cloud Platform IAMOptimize data solutions for performance, scalability, and reliabilitySkillsStrong hands-on experience with Google Cloud Platform (Google Cloud Platform)Expertise in BigQuery (Partitioning, Clustering, Query Optimization)Proven implementation experience with Medallion ArchitectureStrong Python and PySpark programming skillsHands-on Java Development experience (Mandatory)Advanced SQL skills (Joins, Window Functions, Performance Tuning)Experience with Cloud DataflowExperience with Cloud Composer (Airflow)Experience with Google Cloud Storage (GCS)CI/CD Pipelines and GitGoogle Cloud Platform IAM and cloud security best practicesData Lake and Data Warehousing conceptsReal-time streaming frameworksData governance and data quality experienceAgile/Scrum environment experienceCompany OverviewDice is the go-to career marketplace for tech professionals. It was founded in 2010, and is headquartered in Drachten, Friesland, NLD, with a workforce of 201-500 employees. Its website is https://www.or-quest.nl/.