PySpark / Java Developer (Data Engineer)- 100% Remote- Only W2
Key Responsibilities
• Design, develop, and maintain scalable ETL pipelines and data processing applications
• Build and optimize data workflows using PySpark, Java, and Hadoop ecosystem tools
• Analyze business and technical requirements to produce detailed implementation designs
• Perform unit testing, integration testing, and debugging of applications
• Troubleshoot and resolve performance issues related to high-volume data processing
• Develop and maintain SQL queries, stored procedures, and database objects
• Work with structured and unstructured datasets for healthcare analytics
• Generate statistical reports and support data validation processes
• Collaborate with cross-functional teams to ensure end-to-end data pipeline efficiency
• Follow software engineering best practices and maintain code quality standards
Required Skills & Experience
• Strong experience in ETL development, data processing, and database technologies
• 5+ years of experience with Microsoft SQL Server and relational databases
• Expertise in SQL performance tuning, indexing strategies, and query optimization
• 2+ years of experience with Hadoop ecosystem tools (HDFS, Hive, Impala, Spark, Kafka, Oozie, Yarn, Sqoop, Hue)
• Hands-on experience with PySpark, Python, and/or Java
• Experience working with large-scale data processing frameworks
• Strong understanding of data transformation and data movement technologies
• Ability to handle high-volume structured and unstructured datasets
• Good understanding of end-to-end application/data pipeline lifecycle
Apply tot his job
Apply To this Job
• Design, develop, and maintain scalable ETL pipelines and data processing applications
• Build and optimize data workflows using PySpark, Java, and Hadoop ecosystem tools
• Analyze business and technical requirements to produce detailed implementation designs
• Perform unit testing, integration testing, and debugging of applications
• Troubleshoot and resolve performance issues related to high-volume data processing
• Develop and maintain SQL queries, stored procedures, and database objects
• Work with structured and unstructured datasets for healthcare analytics
• Generate statistical reports and support data validation processes
• Collaborate with cross-functional teams to ensure end-to-end data pipeline efficiency
• Follow software engineering best practices and maintain code quality standards
Required Skills & Experience
• Strong experience in ETL development, data processing, and database technologies
• 5+ years of experience with Microsoft SQL Server and relational databases
• Expertise in SQL performance tuning, indexing strategies, and query optimization
• 2+ years of experience with Hadoop ecosystem tools (HDFS, Hive, Impala, Spark, Kafka, Oozie, Yarn, Sqoop, Hue)
• Hands-on experience with PySpark, Python, and/or Java
• Experience working with large-scale data processing frameworks
• Strong understanding of data transformation and data movement technologies
• Ability to handle high-volume structured and unstructured datasets
• Good understanding of end-to-end application/data pipeline lifecycle
Apply tot his job
Apply To this Job