[Remote] Data Engineer
Note: The job is a remote job and is open to candidates in USA. Information Gateways Inc. is seeking a Data Engineer to support enterprise data management activities. The role involves analyzing complex business and data requirements, developing data solutions, and providing technical assistance in data validation and testing processes.ResponsibilitiesSupport enterprise data management activitiesUnderstand and analyze complex business and data requirementsDevelop a broad understanding of the upstream and downstream systems and processes, including impact and gap analysis of current databases and reporting systemsProvide technical assistance as subject matter expert in identifying, evaluating and developing data solutions that meet business requirementsHelp with data validation and testing approach, systems testing, and provide post-production support to the data engineering processes and pipelinesSkillsActive Secret clearance is requiredBachelor's degree in computer science, Information Systems, another related discipline, or equivalent work experience in the software development field will be considered4+ years of data analysis and data engineering experience2+ years of experience building ETL pipelines from multiple database systems using SQL, Spark, Unix, Python, PySpark SQL, Java or C# languages3+ years of experience using data visualization tools such as QlikSense, Tableau, Power BI etcExperience using DatabricksDemonstrated experience with data analysis and tagging for mapping across multiple databases and systemsStrong problem solving and critical thinking skillsStrong analytical backgroundAbility to use Python and SQL in DataBricksSECRET security clearance requiredUnity Catalog a plus (they are doing a WDP (Workload Data Platform) DataBricks migration to Unity CatalogAWS Cloud experience preferred (IAM, S3, EC2, and Glue etc)Experience with Agile developmentExperience with RDBMS such as Oracle 12c, MS SQL Server, DB2 etcDoD system development experience preferredCompany OverviewInformation Gateways, Inc., (IGI) is an established provider of Information Technology Solutions and Services to numerous Government and Commercial clients. It was founded in 1997, and is headquartered in Livonia, Michigan, USA, with a workforce of 51-200 employees. Its website is http://www.infogateway.com.