Data Engineer - Web Scraping
About the job
Job Description:
Responsible for Creating and managing website scraping configurations on web scraping tools.
Responsible for monitoring scraping configurations for potential errors and blockages.
Responsible for monitoring data being scraped to identify potential issues and blockages.
Responsible for coordinating with stakeholders to understand scraping task requirements and reporting issues.
Responsible for preparing and sharing periodic scraping activity reports with stakeholders.
Technical Skillset:
Minimum 3 years of experience working as a data collection and Quality engineer.
Should have hands-on experience working with third-party web scraping tools.
Should have hands-on experience of working with open-source web scraping libraries (e.g. Scrapy, Selenium etc.)
Should be familiar with programming Languages like Python and Go.
Should be Fluent with web technology concepts like HTML, DOM, CSS, XPATH etc.
Should be familiar with the usage of regular expressions for data selection and cleaning purposes.
Should be familiar with Windows and Linux Operating systems and general networking concepts.
Soft Skills:
Should be comfortable with speaking and understanding English.
Should have good written and verbal communication skills.
Should be a good team player with an ownership mindset.
About Cyble:
Cyble provides the fastest and most comprehensive coverage across adversaries, infrastructure, exposure, weaknesses, and targets.
Cyble empowers governments and enterprises to safeguard their citizens and infrastructure by providing critical intelligence in a timely manner and enabling rapid detection, prioritization, and remediation of security threats through its advanced capabilities for data analysis, expert insights, and automated processes.
Headquartered in Alpharetta, Georgia, and with offices in Australia, Malaysia, Singapore, Dubai, Saudi Arabia and India, Cyble has a global presence. To learn more about Cyble, visit www.cyble.com.
Apply tot his job
Apply To this Job
Job Description:
Responsible for Creating and managing website scraping configurations on web scraping tools.
Responsible for monitoring scraping configurations for potential errors and blockages.
Responsible for monitoring data being scraped to identify potential issues and blockages.
Responsible for coordinating with stakeholders to understand scraping task requirements and reporting issues.
Responsible for preparing and sharing periodic scraping activity reports with stakeholders.
Technical Skillset:
Minimum 3 years of experience working as a data collection and Quality engineer.
Should have hands-on experience working with third-party web scraping tools.
Should have hands-on experience of working with open-source web scraping libraries (e.g. Scrapy, Selenium etc.)
Should be familiar with programming Languages like Python and Go.
Should be Fluent with web technology concepts like HTML, DOM, CSS, XPATH etc.
Should be familiar with the usage of regular expressions for data selection and cleaning purposes.
Should be familiar with Windows and Linux Operating systems and general networking concepts.
Soft Skills:
Should be comfortable with speaking and understanding English.
Should have good written and verbal communication skills.
Should be a good team player with an ownership mindset.
About Cyble:
Cyble provides the fastest and most comprehensive coverage across adversaries, infrastructure, exposure, weaknesses, and targets.
Cyble empowers governments and enterprises to safeguard their citizens and infrastructure by providing critical intelligence in a timely manner and enabling rapid detection, prioritization, and remediation of security threats through its advanced capabilities for data analysis, expert insights, and automated processes.
Headquartered in Alpharetta, Georgia, and with offices in Australia, Malaysia, Singapore, Dubai, Saudi Arabia and India, Cyble has a global presence. To learn more about Cyble, visit www.cyble.com.
Apply tot his job
Apply To this Job