[Remote] Senior Engineer - AI
Note: The job is a remote job and is open to candidates in USA. XCUTIVES INC. is looking for a Senior Engineer specializing in AI. This role focuses on building and maintaining data pipelines and infrastructure for AI agent systems, ensuring high-quality data access for AI models and agents, while engaging in client-facing consulting across various industries.ResponsibilitiesBuilding and maintaining the data pipelines and infrastructure that fuel AI agent systemsEnsuring that AI models and agents have continuous access to high-quality, timely dataHandling a wide array of data: financial transactions for BFSI AI solutions, sensor and machine data for Manufacturing AI, patient or research data for Life Sciences AI, and moreSkillsStrong programming skills, especially in Python, and experience with other languages like SQLPractical experience building data pipelines end-to-endProficiency in writing and optimizing SQL queriesExperience with big data technologies like Apache SparkFamiliarity with streaming frameworks and tools like KafkaAbility to interact with web APIs for data ingestion or extractionStrong understanding of data formats and ability to parse JSON, XML, or custom text formatsBasic DevOps skills, including using Git for version control and CI/CD pipelinesStrong ability to troubleshoot data issuesAttentiveness to data quality and skills in implementing checks and validating outputsGood communication skills to work with the team and clientsAbility to handle multiple tasks and prioritize effectivelyAptitude to learn domain context from dataUnderstanding of handling sensitive data securely in pipelinesWillingness to learn new tools or frameworks as neededExperience with tools such as Apache Airflow, Informatica PowerCenter, or cloud-based ones like Azure Data FactoryProficiency in Apache Spark and knowledge of Hadoop HDFSStrong practical SQL skills and familiarity with relational database systemsKnowledge of specific systems like MongoDB or CassandraHands-on usage of Apache Kafka and understanding of consumer group mechanicsFamiliarity with cloud storage services like Amazon S3 and cloud compute for ETLExperience building or using connectors to RESTful APIsUnderstanding of various file formats and ability to convert between themComfortable with Linux shell and basic shell scriptingUsing Git for source control and setting up CI pipelines for data projectsUtilizing monitoring tools for data workflowsBasics of tools like Excel or Python's Jupyter notebooks for data sanity checksUnderstanding network configurations for data transferFamiliarity with PyTest or unittest for writing tests for data transformationsExperience with tools like JIRA and documentation toolsBonus if you understand some AI/ML fundamentalsCompany OverviewXCUTIVES.COM Inc. is a global talent services provider with a successful track record spanning nearly seven years. It was founded in 2017, and is headquartered in Princeton, New Jersey, USA, with a workforce of 11-50 employees. Its website is https://www.xcutives.com.