Hey, Testers!
AI in Testing is the latest buzzword and one of the most hyped topics in the tech world today. Understanding the potential benefits and being mindful of the risks associated with using AI, particularly Generative AI, in testing is crucial. In this compilation, you’ll find a curated list of materials, references, and resources on AI in Testing. It’s important to note that this is distinct from Testing in AI, so don’t get the two confused. Let’s dive in!
Learning Resources
- AI in Testing by Rahul’s Testing Titbits – YouTube
- Software Testing and AI | Ministry of Testing
- 30 Days of AI in Testing | Ministry of Testing
- Prompting Checklist for Testers – Rahul’s Testing Titbits
- WAIT (Workshop on AI in Testing) – Satisfice, Inc.
- What Skills Are Required for an AI-Assisted Testing Team?
- Incorporating AI in Testing at Work
- Prompt Engineering Guide | Prompt Engineering Guide (promptingguide.ai)
- Prompt Engineering for Testers: Unleashing the Power of LLMs
Critical Thinking Stuff
- Appendix: ChatGPT Sucks at Being a Testing Expert
- A Super-Quick Guide to Evaluating “AI” Claims
- Challenging The Myths of Generative AI
- It can’t be that stupid, you must be prompting wrong
- A Reply to “Running a crowd-sourced experiment on using LLMs for testing” – DevelopSense
- The LLMentalist Effect
- Shining a Light on “Shadow Prompting”
- James Bach Shares His Opinion on #SoftwareTesting and #ChatGPT
- Reversal Curse: LLMs trained on “A is B” fail to learn “B is A”
- Who answers it better – ChatGPT vs StackOverflow
People to Follow
AI in Testing Tools
- AI Testing Tools – Compilation
- TestCraft – AI-Powered Testing Assistant
- Joe Bot AI | Test Guild – Automation Testing Tools Community
- TestHatch – Test Generator Tool
- Code Tests for Busy Devs | CodiumAI
- Personal AI Platform For You | AICamp
- Claude AI
Prompting Hubs
AI in Testing Tools – II
- ChatGPT – PromptGPT – Convert task into organized Markdown-based prompt.
- ChatHub – All-in-one chatbot client – Compare responses of multiple LLMs.
How AI & LLMs Work
AI in Testing Tools – III
- Kusho AI – Transform your API specs into exhaustive tests using AI
- The multimodal synthetic data platform for developers — Gretel.ai
Update Log:
- 28 July 2024: First version released. This resource directory will continue to grow with new updates and resources coming up over time.
