Qa engineer with GCP experience
JOB DESCRIPTION
Key Skills: GCP Test Automation, CI/CD, API & UI testing automation, experience with Playwright framework and exposure to GenAI for test automation use case
What you will do:
API and Integration Testing:
ā¢ Design, develop, and execute comprehensive API test plans and test cases for AI models and services, covering functional, performance, security, and contract testing.
ā¢ Conduct rigorous testing of new language models (commercial and open source) via their APIs, focusing on accuracy, performance, scalability, and cost effectiveness.
ā¢ Validate data integrity and consistency across various API endpoints and integrations.
ā¢ Implement and maintain API test automation frameworks and tools.
Automation Development and Execution:
ā¢ Develop and maintain automated test scripts using Python and relevant testing frameworks to maximize test coverage and efficiency.
ā¢ Automate the testing of containerized microservices running in Google Cloud Platform (GCP) using appropriate CI/CD pipelines.
ā¢ Champion automation best practices and drive continuous improvement in automation coverage.
ā¢ Develop and maintain performance testing scripts for API endpoints and backend services.
AI Model Evaluation Framework Validation:
ā¢ Ensure the evaluation framework provides a robust and reliable environment for testing the latest AI offerings via automated processes.
ā¢ Develop automated tests to validate the functionality and performance of the evaluation framework itself.
ā¢ Implement automated reporting and analysis of test results.
ā¢ Run automated tests against one or multiple language models simultaneously through API interfaces.
Collaboration and Communication:
ā¢ Work closely with software engineers, data scientists, and other stakeholders to understand requirements and ensure the delivery of high quality AI solutions.
ā¢ Clearly communicate technical concepts and testing results to both technical and non technical stakeholders.
ā¢ Continuous Improvement:
ā¢ Stay abreast of the latest advancements in quality engineering, API testing, and AI technologies, incorporating best practices into the AI Hubs testing processes.
ā¢ Continuously evaluate and improve
Apply tot his job
Apply To this Job
Key Skills: GCP Test Automation, CI/CD, API & UI testing automation, experience with Playwright framework and exposure to GenAI for test automation use case
What you will do:
API and Integration Testing:
ā¢ Design, develop, and execute comprehensive API test plans and test cases for AI models and services, covering functional, performance, security, and contract testing.
ā¢ Conduct rigorous testing of new language models (commercial and open source) via their APIs, focusing on accuracy, performance, scalability, and cost effectiveness.
ā¢ Validate data integrity and consistency across various API endpoints and integrations.
ā¢ Implement and maintain API test automation frameworks and tools.
Automation Development and Execution:
ā¢ Develop and maintain automated test scripts using Python and relevant testing frameworks to maximize test coverage and efficiency.
ā¢ Automate the testing of containerized microservices running in Google Cloud Platform (GCP) using appropriate CI/CD pipelines.
ā¢ Champion automation best practices and drive continuous improvement in automation coverage.
ā¢ Develop and maintain performance testing scripts for API endpoints and backend services.
AI Model Evaluation Framework Validation:
ā¢ Ensure the evaluation framework provides a robust and reliable environment for testing the latest AI offerings via automated processes.
ā¢ Develop automated tests to validate the functionality and performance of the evaluation framework itself.
ā¢ Implement automated reporting and analysis of test results.
ā¢ Run automated tests against one or multiple language models simultaneously through API interfaces.
Collaboration and Communication:
ā¢ Work closely with software engineers, data scientists, and other stakeholders to understand requirements and ensure the delivery of high quality AI solutions.
ā¢ Clearly communicate technical concepts and testing results to both technical and non technical stakeholders.
ā¢ Continuous Improvement:
ā¢ Stay abreast of the latest advancements in quality engineering, API testing, and AI technologies, incorporating best practices into the AI Hubs testing processes.
ā¢ Continuously evaluate and improve
Apply tot his job
Apply To this Job