Job description
Responsibilities
1. Responsible for functional testing, regression testing, and compatibility testing of Web, App, management backend, and API.
2. Participate in requirement reviews, develop test plans and design test cases based on product requirements and interface documents.
3. Submit high-quality defect records and drive closure, responsible for regression before launch and post-launch issue reviews.
4. Write and maintain interface automation scripts to improve regression efficiency of core links.
5. Participate in UI automation, performance testing, and quality tool development as needed by the project.
6. Build an AI testing workflow from scratch, covering prompt management, evaluation processes, issue sample closure, and version regression mechanisms, while documenting reusable standards and documentation.
7. Responsible for quality testing of AI product scenarios such as dialogue, agents, and generative content.
8. Establish and maintain an issue sample library, covering factual errors, off-topic responses, style drift, and safety boundary issues.
9. Participate in prompt version regression and A/B testing, producing test reports and improvement suggestions.
Requirements
1. Bachelor's degree or above, with more than three years of software testing experience, familiar with the full process of Web, App, and API testing.
2. Familiar with interface testing and packet capture tools, able to independently locate common issues.
3. Familiar with at least one automation or performance testing framework such as Pytest, Selenium, Playwright, Appium, JMeter.
4. Familiar with Git and common project collaboration tools.
5. Ability to build testing processes and quality standards from scratch, able to independently organize standard operating procedures.
6. Genuine interest and practical experience in AI products, able to write prompts or complete small projects.
7. Clear communication and strong execution ability, able to drive issue closure across product, development, and algorithm teams.
Bonus Points
1. Experience in testing AI products such as dialogue, generative content, and agents.
2. Experience in prompt regression, issue sample analysis, or model output evaluation.
3. Experience in building testing systems, testing platforms, or quality processes from scratch.
4. Experience using AI testing or large model observability tools, understanding retrieval-augmented generation, tool invocation, and agent workflows.
5. Good English reading ability, able to read official technical documentation.