[Remote] Technical Lead – Data Engineering
Note: The job is a remote job and is open to candidates in USA. Cognizant is seeking a highly experienced Technical Lead – Data Engineering with expertise in delivering enterprise-scale data solutions on AWS. This role involves designing, building, and modernizing data platforms, developing complex data engineering solutions, and contributing to cloud transformation initiatives.ResponsibilitiesDesign, build, and optimize scalable data engineering solutions using AWS cloud servicesDevelop and maintain robust ETL pipelines using AWS Glue (PySpark/Python) to process large-scale data efficientlyImplement and enhance data integration frameworks leveraging Glue Data Catalog, Crawlers, and S3/JDBC sourcesDevelop high-performance data processing logic using PySpark, Python, and SQLContribute to cloud data migration initiatives from on-premises systems to AWS (RDS PostgreSQL/Aurora) using AWS SCT, DMS, or custom frameworksOrchestrate and manage data workflows using AWS Step Functions, Glue Workflows, and event-driven servicesCollaborate with cross-functional teams to understand data requirements and deliver scalable data solutionsMonitor, troubleshoot, and optimize data pipelines using CloudWatch and other AWS monitoring toolsEnsure data quality, performance, and reliability across all data engineering processesFollow best practices in coding, testing, and deployment to maintain high-quality deliverablesSkills10+ years of experience in IT with a strong focus on Data Engineering and AnalyticsProven hands-on experience designing and developing scalable data pipelines using Apache Spark (PySpark)Strong expertise in AWS services, including Glue, S3, Lambda, Step Functions, Athena, RDS (PostgreSQL/Aurora), EventBridge, SNS, SQS, SES, and CloudWatchExtensive experience building and optimizing ETL pipelines using AWS Glue (PySpark/Python)Experience in data migration from on-premises systems to AWS using tools such as AWS SCT and DMS or custom frameworksStrong programming skills in Python, SQL, and UNIX Shell scriptingExperience working with Glue Data Catalog, Glue Crawlers, and handling structured and unstructured data sourcesSolid understanding of data modeling, performance tuning, and optimization techniques for large-scale datasetsHands-on experience with UNIX/Linux environmentsAbility to work independently in a fast-paced environment and contribute to complex technical solutionsBachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience)Experience with serverless and event-driven architectures on AWSStrong understanding of data lake and data warehousing conceptsHands-on experience with performance tuning and cost optimization in AWS data pipelinesFamiliarity with reporting and BI tools such as CognosExperience working with large-scale, high-volume data processing systemsExposure to CI/CD pipelines and DevOps practices for data engineering workflowsStrong problem-solving skills with the ability to troubleshoot complex data and system issuesExcellent collaboration and communication skills in a cross-functional environmentBenefitsCognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.Medical/Dental/Vision/Life InsurancePaid holidays plus Paid Time Off401(k) plan and contributionsLong-term/Short-term DisabilityPaid Parental LeaveEmployee Stock Purchase PlanCompany OverviewCognizant is a professional services company that helps clients alter their business, operating, and technology models for the digital era. It was founded in 1994, and is headquartered in Teaneck, New Jersey, USA, with a workforce of 10001+ employees. Its website is https://www.cognizant.com.