[Remote] Full Stack Data Engineer
Note: The job is a remote job and is open to candidates in USA. rockITdata is a unique SDVOSB services company that partners with leading commercial healthcare/life sciences organizations on cutting edge innovations. They are seeking a talented and experienced Full Stack Data Engineer to join their team, responsible for building end-to-end data solutions and contributing to the development of innovative data-driven applications.ResponsibilitiesDesign and implement scalable data ingestion pipelines to efficiently collect and process data from various sourcesIntegrate data from different systems and platforms to create unified datasets for analysis and reportingDevelop and maintain data storage solutions such as data lakes, data warehouses, and NoSQL databasesOptimize data storage and retrieval mechanisms for performance, scalability, and cost-effectivenessImplement data processing workflows for cleaning, transforming, and enriching raw data into usable formatsApply data transformation techniques such as ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processesDesign and implement data models to support analytical and reporting requirementsOptimize data models for query performance, data integrity, and storage efficiencyBuild software applications and APIs to expose data services and functionality to other systems and applicationsIntegrate data engineering workflows with existing software systems and platformsEstablish monitoring and alerting mechanisms to track the health and performance of data pipelines and systemsConduct regular maintenance activities to ensure the reliability, availability, and scalability of data infrastructureDocument data engineering processes, architectures, and solutions to facilitate knowledge sharing and collaborationCollaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand requirements and deliver solutionsSkillsBachelor's or Master's degree in Computer Science, Engineering, or a related fieldProficiency in programming languages such as Python, Java, or Scala for data engineering and software developmentExpert-level skills in data visualization platforms beyond Tableau and Power BI (e.g. Qlik)Strong understanding of database concepts, data modeling techniques, and SQL programmingHands-on experience with cloud platforms such as AWS, Azure, or GCP for building and deploying data solutionsKnowledge of data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake)Familiarity with version control systems (e.g., Git) and software development best practices (e.g., Agile, CI/CD)Experience building solutions for Commercial clients in Pharma, Biotech, CPG, Retail or Manufacturing industriesExperience with containerization technologies such as Docker and orchestration tools like KubernetesKnowledge of streaming data processing frameworks (e.g., Apache Flink, Apache Kafka Streams)Familiarity with data governance and security practices for protecting sensitive dataStrong problem-solving skills and the ability to troubleshoot complex data engineering issuesExcellent communication skills and the ability to collaborate effectively in a team environmentCompany OverviewRockITdata is an IT firm that offers AWS consultation, data integration, cloud computing and staffing services. It was founded in 2018, and is headquartered in Philadelphia, Pennsylvania, USA, with a workforce of 51-200 employees. Its website is https://www.rockitdata.com.Company H1B SponsorshiprockITdata has a track record of offering H1B sponsorships, with 2 in 2023, 1 in 2020. Please note that this does not guarantee sponsorship for this specific role.