[Remote] GCP Data Engineer
Note: The job is a remote job and is open to candidates in USA. N2P Systems is seeking a highly skilled Data Engineer with deep expertise in Google Cloud Platform (GCP) and modern data architecture. The ideal candidate will design scalable data pipelines and implement Medallion Architecture for building robust enterprise-grade data solutions.ResponsibilitiesDesign, develop, and maintain scalable batch and real-time data pipelines on GCPImplement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data processingBuild high-performance data transformations using Python and PySparkDevelop and optimize complex SQL queries for analytical workloadsWork extensively with BigQuery for large-scale data processing and performance tuningDevelop and deploy pipelines using Cloud DataflowOrchestrate workflows using Cloud Composer (Apache Airflow)Manage data storage and lifecycle using Google Cloud Storage (GCS)Implement version control and CI/CD pipelines using Git-based toolsEnsure data security, governance, and access control using GCP IAMOptimize data solutions for performance, scalability, reliability, and cost-efficiencySkillsStrong hands-on experience with Google Cloud Platform (GCP)Expertise in BigQuery (partitioning, clustering, query optimization)Proven experience implementing Medallion Data ArchitectureStrong programming skills in Python and PySparkAdvanced proficiency in SQL (complex joins, window functions, performance tuning)Hands-on experience with Cloud DataflowExperience with Cloud Composer (Airflow) for orchestrationExperience working with Google Cloud Storage (GCS)Knowledge of version control systems (Git) and CI/CD practicesStrong understanding of GCP IAM and cloud security best practicesHands-on experience with Java is mandatoryExperience working with large-scale enterprise data platformsKnowledge of data warehousing and data lake conceptsFamiliarity with real-time streaming frameworksExperience in data governance and data quality frameworksExposure to Agile/Scrum methodologiesCompany Overview It was founded in undefined, and is headquartered in Mississauga, Ontario, CA, with a workforce of 11-50 employees. Its website is https://n2psystems.ca.