Big Data Developer
Job title: Big Data Developer in USA at ACS Consultancy Services
Company: ACS Consultancy Services
Job description: Job Title: Big Data DeveloperLocation: RemoteWe are currently seeking candidates who meet the following qualifications. Responsibilities:
Design and develop scalable data pipelines
Work with structured, semi-structured, and unstructured data
Implement data ingestion and processing using Hadoop, Spark, and Kafka
Write optimized Hive, HQL, and Spark SQL queries
Build data APIs and interfaces for analytics teams
Monitor data pipelines for performance and reliability
Maintain documentation and data lineage tracking
Requirements:
Bachelor's in Computer Science, Engineering, or similar
Experience in Big Data development
Proficiency in Java/Scala/Python for data processing
Expertise in Spark, Hive, HDFS, Sqoop, Flume, or Impala
Experience with Kafka or other real-time data tools
Strong SQL and NoSQL database skills
Experience in workflow tools (Airflow, Oozie, NiFi)
Cloud experience (AWS EMR, Azure Synapse, GCP BigQuery)
Experience in building data lakes and data warehouses
Knowledge of data security and compliance (GDPR, HIPAA)
Experience in Delta Lake, Iceberg, or Hudi
Understanding of CI/CD for data pipelines
Federal Experience is a plus.
Required Security clearance.
If you meet these qualifications, please submit your application via link provided in Linkedin.
Kindly do not call the general line to submit your application.
Expected salary:
Location: USA
Apply for the job now!
Apply Now
Company: ACS Consultancy Services
Job description: Job Title: Big Data DeveloperLocation: RemoteWe are currently seeking candidates who meet the following qualifications. Responsibilities:
Design and develop scalable data pipelines
Work with structured, semi-structured, and unstructured data
Implement data ingestion and processing using Hadoop, Spark, and Kafka
Write optimized Hive, HQL, and Spark SQL queries
Build data APIs and interfaces for analytics teams
Monitor data pipelines for performance and reliability
Maintain documentation and data lineage tracking
Requirements:
Bachelor's in Computer Science, Engineering, or similar
Experience in Big Data development
Proficiency in Java/Scala/Python for data processing
Expertise in Spark, Hive, HDFS, Sqoop, Flume, or Impala
Experience with Kafka or other real-time data tools
Strong SQL and NoSQL database skills
Experience in workflow tools (Airflow, Oozie, NiFi)
Cloud experience (AWS EMR, Azure Synapse, GCP BigQuery)
Experience in building data lakes and data warehouses
Knowledge of data security and compliance (GDPR, HIPAA)
Experience in Delta Lake, Iceberg, or Hudi
Understanding of CI/CD for data pipelines
Federal Experience is a plus.
Required Security clearance.
If you meet these qualifications, please submit your application via link provided in Linkedin.
Kindly do not call the general line to submit your application.
Expected salary:
Location: USA
Apply for the job now!
Apply Now