Summarize with AIChatGPTClaudePerplexity
AI in Testing
A hand-curated field guide to the resources that actually matter: the foundations worth understanding, the prompts and tools worth using, and the critical voices worth trusting. Built for testers who want signal over slop. This is AI in Testing, not Testing of AI.
01 · The Signature Collection
7Start Here
Course★Gen AI for Testers: Free Certification CourseA free, structured on-ramp. The place to begin if GenAI for testing is new to you.shiftsync.tricentis.com↗Framework★AI Prompt Repository for TestersA living library of battle-tested prompts built for real testing tasks.testingtitbits.com↗GuidePrompting Checklist for TestersThe pre-flight checklist that turns a vague prompt into a reliable one.testingtitbits.com↗Framework★AI Usage Quadrants for TestersA decision model for when AI genuinely helps, and when it quietly hurts.testingtitbits.com↗FrameworkAI Model Selection for TestersChoose the right model by weighing task complexity against knowledge currency.testingtitbits.com↗ReadThe Fine Print of Using AI Tools in TestingThe risks, limits and disclaimers every tester should read before trusting output.testingtitbits.com↗WatchAI in Testing Video SeriesAn ongoing video series on applying AI to everyday testing work.youtube.com↗
02 · First Principles
10Foundations
Read★What Is ChatGPT Doing… and Why Does It Work?Stephen Wolfram’s definitive deep-dive on how LLMs actually generate text.writings.stephenwolfram.com↗ToolTransformer ExplainerAn interactive, visual walkthrough of a live GPT-2. Watch attention in motion.poloclub.github.io↗ReadA Conceptual Guide to TransformersA philosopher’s clear, math-light explanation of the transformer.benlevinstein.substack.com↗Tool★LLM VisualizationWalk through a working LLM in 3D, layer by layer, weight by weight.bbycroft.net↗ToolTiktokenizerSee exactly how a prompt is tokenized, and why token count matters.tiktokenizer.vercel.app↗ReadFineWeb: Decanting the Web for the Finest Text DataHow a state-of-the-art training dataset is filtered out of the raw web.huggingface.co↗DatasetFineWeb-Edu DatasetThe educational-quality dataset behind many strong open models.huggingface.co↗Tool★Chatbot Arena (LMArena)Crowd-sourced blind rankings of frontier models, head to head.lmarena.ai↗DirectoryAll Large Language Models DirectoryA searchable directory of nearly every model on the market.llmmodels.org↗ReadAI News by ButtondownA dense daily digest of what actually shipped in AI.buttondown.com↗
03 · The Craft of Prompting
14Prompting
Guide★Prompt Engineering GuideThe most comprehensive open reference on prompting techniques.promptingguide.ai↗Framework2,500+ ChatGPT Prompt TemplatesA vast starter pack to adapt and remix for testing workflows.ignacio-velasquez.notion.site↗FrameworkAwesome ChatGPT PromptsThe classic community-curated prompt collection on GitHub.github.com↗GuideGoogle Cloud Prompt GalleryProduction-grade prompt samples straight from Google’s playbook.cloud.google.com↗DirectorySnack PromptBrowse and remix trending prompts by category.snackprompt.com↗PlaygroundGoogle AI StudioA free playground to prototype prompts against Gemini.aistudio.google.com↗PlaygroundVertex AI StudioEnterprise-grade prompt optimization and refinement.console.cloud.google.com↗ToolAICampCompare multiple LLMs side by side in one workspace.app.aicamp.so↗Tool★LM StudioDiscover, download and run open LLMs entirely on your own machine.lmstudio.ai↗Framework★System Prompts of AI ToolsA collected archive of the system prompts behind popular AI tools. A masterclass in prompt design.github.com↗ToolPromptGPTTurns a rough task into a clean, structured Markdown prompt.chatgpt.com↗ToolPromptProAn open-source app for refining and enhancing prompt outputs.github.com↗GuideAI-Powered Prompt Writing (Google Cloud)Google’s guide to using AI to write better prompts.cloud.google.com↗ToolChatHubQuery several chatbots at once and compare their answers.chathub.gg↗
04 · From Theory to Practice
8In Practice
Course★30 Days of AI in TestingMinistry of Testing’s structured, month-long hands-on challenge.ministryoftesting.com↗GuideAI in Testing RoadmapA staged learning pathway from the basics to applied practice.muuktest.com↗ReadIncorporating AI in Testing at WorkPractical patterns for bringing AI into a real team.shiftsync.tricentis.com↗ReadPrompt Engineering for TestersTester-specific prompting techniques, with worked examples.testsigma.com↗Book★Software Testing with Generative AIMark Winteringham’s hands-on book on applying GenAI to testing.manning.com↗ReadWhat Skills an AI-Assisted Testing Team NeedsThe capability mix an AI-era testing team actually requires.muuktest.com↗WatchSLOP to KINO (ShiftSync Webinar)A live session on telling AI slop apart from genuine quality signal.shiftsync.tricentis.com↗Course★MCP Servers & Automation for TestersA course on wiring up MCP servers to automate testing tasks.shiftsync.tricentis.com↗
05 · The Skeptic’s Shelf
10Critical Thinking
Read★Is There Something in Your "I"?James Bach on what intelligence really means for testers.satisfice.com↗ReadChatGPT Sucks at Being a Testing ExpertA pointed appendix documenting where the model falls down.satisfice.com↗Read★A Super-Quick Guide to Evaluating AI ClaimsMichael Bolton’s sharp filter for cutting through AI hype.developsense.com↗ReadA Reply to a Crowd-Sourced LLM Testing ExperimentA careful critique of a widely shared LLM-for-testing study.developsense.com↗Read★The LLMentalist EffectWhy LLMs feel intelligent: the cold-reading illusion, explained.softwarecrisis.dev↗ReadThe 70% ProblemAddy Osmani on why AI gets you 70% of the way and then stalls.addyo.substack.com↗PaperReversal CurseResearch showing models trained on 'A is B' often fail to learn 'B is A'.arxiv.org↗PaperChatGPT vs Stack Overflow: Who Answers Better?An empirical comparison of ChatGPT and Stack Overflow answers.arxiv.org↗ReadShining a Light on Shadow PromptingOn the hidden prompts quietly shaping AI behaviour.techpolicy.press↗ReadPivot to AIRunning commentary on AI overreach and broken promises.pivot-to-ai.com↗
06 · The Next Frontier
4Agentic AI
Read★AI Agents in Testing: The 5W1H Framework (Part 1)A clear framework for reasoning about AI agents in testing.shiftsync.tricentis.com↗ReadAI Agents in Testing: The 5W1H Framework (Part 2)Part two: applying the 5W1H framework in practice.shiftsync.tricentis.com↗WatchAI Agents for Testers: MasterclassA practical masterclass recording built on the 5W1H framework.shiftsync.tricentis.com↗FrameworkAI Engineering Resources (aie-book)Chip Huyen’s open resource set for serious AI engineers.github.com↗
07 · Voices Worth Following
10People
Community★Andrej KarpathyFoundational, accessible teaching from a leading AI researcher.karpathy.ai↗WatchAndrej Karpathy on YouTubeHis legendary build-an-LLM-from-scratch lectures.youtube.com↗CommunityMichael BoltonRapid Software Testing co-author and a leading critical voice.linkedin.com↗CommunityRahul VermaA deep thinker on testing craft and automation design.linkedin.com↗CommunityDragan SpiridonovAn active voice at the AI-and-testing intersection.linkedin.com↗CommunityRahul ParwalFollow along for ongoing AI-in-testing work and experiments.linkedin.com↗Community★AI Chapter , Ministry of TestingMinistry of Testing’s community hub for AI in testing.ministryoftesting.com↗CommunityShiftSync CommunityTricentis’ community for modern testing practice.shiftsync.tricentis.com↗WatchAI Engineer on YouTubeTalks from the leading AI engineering conference.youtube.com↗WatchAI & Beyond AI on YouTubeAI literacy explained for a general audience.youtube.com↗
08 · The Testing Stack
10Tools
DirectoryAI Testing Tools (Compilation)A broad, regularly-updated compilation of AI-powered testing tools.aitesting.tools↗DirectoryTestingTools.aiAnother curated directory of AI-powered testing tools.testingtools.ai↗ToolTestCraftAI-assisted, codeless test automation.home.testcraft.app↗ToolTestHatchGenerates test cases from your requirements.testhatch.com↗ToolCodiumAIGenerates meaningful tests for busy developers.codium.ai↗ToolJoe Bot AI (TestGuild)TestGuild’s AI assistant for automation questions.testguild.com↗ToolAmikoo by MuukTestAI agents paired with human experts for test automation.muuktest.com↗Tool★Gretel.aiSynthetic test-data generation at scale.gretel.ai↗Directory★Future ToolsA constantly-updated finder for the exact AI tool you need.futuretools.io↗DirectoryThere’s An AI For ThatSearch for an AI tool for almost any task.theresanaiforthat.com↗
No resources match that search. Try a broader term.