Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
All tags on a page
- ai-testing 13
- testing 12
- llm 10
- AI 8
- automation 7
- mcp 7
- model-context-protocol 7
- qa 6
- AI-ML 6
- Roadmap 5
- Quality Engineering 5
- Strategy 5
- Maturity Assessment 5
- evals 5
- llm-as-a-judge 5
- llm-evals 5
- javascript 4
- api 4
- docker 4
- AI Fundamentals 4
- Agentic 4
- prompt-engineering 4
- quality-engineering 4
- node 3
- tools 3
- quality engineering 3
- llm-tools 3
- transformers 3
- guardrails 3
- ai-native 3
- spec-driven-development 3
- human-in-the-loop 3
- security 2
- dev 2
- tutorial 2
- ai 2
- api-testing 2
- engineering 2
- Shift-Left 2
- Testing 2
- Automation 2
- Test Data 2
- leadership 2
- test automation 2
- Enterprise Testing 2
- MCP 2
- ai-architecture 2
- developer-tools 2
- llm-reliability 2
- llm-evaluation 2
- model-evaluation 2
- software-architecture 2
- serverless 1
- welcome 1
- openBanking 1
- banking 1
- CDR 1
- dataSharing 1
- fintech 1
- finance 1
- algorithm 1
- team work 1
- nvm 1
- linux 1
- SoftwareTesting 1
- Leadership 1
- TestingLeadership 1
- QualityAssurance 1
- code 1
- shift-left 1
- qualityAndTesting 1
- collaboration 1
- EarlyFeedback 1
- microservices 1
- development 1
- java 1
- nightwatch 1
- end-to-end 1
- automated-testing 1
- javaScript 1
- e2e 1
- grad 1
- intern 1
- uni 1
- career 1
- personal 1
- experience 1
- quality 1
- usertesting 1
- alpha 1
- beta 1
- appium 1
- mobile-automation 1
- performance-testing 1
- k6 1
- html-reporting 1
- blog 1
- Jekyll 1
- Shift-Left & Right 1
- Agile Testing 1
- archialgorithm 1
- performance testing 1
- Test automation 1
- selenium 1
- webdriver 1
- json 1
- strategic 1
- 2024-reflection 1
- quality assurance 1
- QA 1
- automation testing 1
- SDETs 1
- Test Leadership 1
- Project Management 1
- QA Strategy 1
- Team Collaboration 1
- Quality Engineering Leadership 1
- QE 1
- Start up 1
- Collaboration 1
- testing-at-scale 1
- cicd 1
- type-script 1
- readme 1
- chatbot 1
- Developers 1
- Data Science 1
- Agents 1
- A2A 1
- conference 1
- speaking 1
- meetups 1
- Keynote 1
- Topmate 1
- Mentoring 1
- tool-calling 1
- ai-reliability 1
- sdet 1
- playwright-mcp 1
- mcp-tools 1
- vscode-mcp 1
- coding-assistant 1
- ai-leadership 1
- cto 1
- ai-governance 1
- multi-agent 1
- agentic-workflows 1
- autonomous-agents 1
- large-language-model 1
- ai-for-testers 1
- tokenization 1
- llm-prompts 1
- context-window 1
- llm-costs 1
- embeddings 1
- word-vectors 1
- semantic-search 1
- vector-databases 1
- attention-mechanism 1
- self-attention 1
- llm-prompting 1
- transformer-architecture 1
- attention-layers 1
- llm-internals 1
- pre-training 1
- next-token-prediction 1
- masked-language-modeling 1
- llm-training 1
- fine-tuning 1
- lora-peft 1
- supervised-fine-tuning 1
- llm-customization 1
- zero-shot 1
- few-shot 1
- prompting 1
- generative-ai 1
- hallucination 1
- llm-safety 1
- fact-checking 1
- open-banking 1
- australian-cdr 1
- ai-assistant 1
- banking-automation 1
- claude 1
- cursor 1
- constitution-md 1
- test-strategy 1
- ai-agents 1
- test-harness 1
- harness-engineering 1
- continuous-testing 1
- regression-testing 1
- agent-reliability 1
- qa-for-ai 1
- machine-learning 1
- ml-pipeline 1
- data-engineering 1
- model-training 1
- model-monitoring 1
- mlops 1
- reproducibility 1
- feature-engineering 1
- deployment 1
- data-drift 1
- rag 1
- ollama 1
- qdrant 1
- python 1
- langchain 1
- ragas 1
- local-ai 1
- jekyll 1
- devops 1
- productivity 1
- jeklly 1
- GitHub pages 1
- multi-code tabs 1
ai-testing
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
LLM Hallucinations: Why Models Invent Facts Confidently
Written by - Millan Kaul
Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing
Written by - Millan Kaul
LLM Fine-tuning: Customize Powerful Models for Your Needs
Written by - Millan Kaul
LLM Pre-training: Learning From Trillions of Words
Written by - Millan Kaul
Transformer Architecture: The Engine Behind Every LLM
Written by - Millan Kaul
Attention Mechanism: How LLMs Decide βWhat Matters Mostβ
Written by - Millan Kaul
Word Embeddings: How AI Understands βSimilar Meaningβ
Written by - Millan Kaul
What is Tokenization? How LLMs See Your Text
Written by - Millan Kaul
What is an LLM - Large Language Model ?
Written by - Millan Kaul
testing
k6 - web dashboards + HTML report π
Written by - Millan Kaul
Easiest way to understand How Appium works
Written by - Millan Kaul
A/B Tetsing - in 5 steps
Written by - Millan Kaul
A tasty analogy: Quality and testing explained like a piece of cake π°
Written by - Millan Kaul
7 most used util and helper methods in test automation project
Written by - Millan Kaul
Evolution of Reliability Tester and AI testing
Written by - Karthik Hariharan
Exploratory Testing π + Automation βοΈ
Written by - Millan Kaul
Plus Ca Change in Test Automation
Written by - Paul Maxwell-Walters
Love-Hate Relationship with Selenium Automation
Written by - Millan Kaul
Why test automation will be key focus in 2023 ?
Written by - Millan Kaul
Running a local server and API testing in less than 10 minutes
Written by - Millan Kaul
5 misconceptions regarding Test Automation
Written by - Millan Kaul
llm
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
LLM Hallucinations: Why Models Invent Facts Confidently
Written by - Millan Kaul
Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing
Written by - Millan Kaul
LLM Fine-tuning: Customize Powerful Models for Your Needs
Written by - Millan Kaul
LLM Pre-training: Learning From Trillions of Words
Written by - Millan Kaul
Transformer Architecture: The Engine Behind Every LLM
Written by - Millan Kaul
Attention Mechanism: How LLMs Decide βWhat Matters Mostβ
Written by - Millan Kaul
Word Embeddings: How AI Understands βSimilar Meaningβ
Written by - Millan Kaul
What is Tokenization? How LLMs See Your Text
Written by - Millan Kaul
What is an LLM - Large Language Model ?
Written by - Millan Kaul
AI
The Hidden Cost of Quality Debt: What Leadership Doesnβt See
Written by - Gavin Cheung
How AI Agents Actually Collaborate: Real-World Workflows, Protocols, and Pitfalls
Written by - Millan Kaul
5 Well-Known and 5 Less-Known MCP Concepts with Examples
Written by - Millan Kaul
15 AI terms related or similar to MCP (Model Context Protocol) and Agent
Written by - Millan Kaul
20 AI acronyms and keywords with definitions and use cases
Written by - Millan Kaul
10 Foundational AI Building Block Concepts for Testers and Developers
Written by - Millan Kaul
A live implementation of a chatbot
Written by - Millan Kaul
2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM
Written by - Millan Kaul
automation
How I turned my blog into a Docker based development paradise π³ - Try It Yourself!
Written by - Millan Kaul
k6 - web dashboards + HTML report π
Written by - Millan Kaul
Easiest way to understand How Appium works
Written by - Millan Kaul
7 most used util and helper methods in test automation project
Written by - Millan Kaul
Love-Hate Relationship with Selenium Automation
Written by - Millan Kaul
Why test automation will be key focus in 2023 ?
Written by - Millan Kaul
5 misconceptions regarding Test Automation
Written by - Millan Kaul
mcp
Open Banking MCP: Compare Bank Rates in Your AI Assistant
Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...
Where MCP Shines
βSingle LLMs hallucinate. Multiβagent systems multiply the problem.β
MCP: 5 Leadership Lessons
From hype to control. Here are the 5 truths every CTO must know.
How MCP Works?
βMCP handshake β tool call β your code runs. 3 minutes to understand.β
Why MCP?
βLast week my LLM swore the 2024 World Cup winner was βMoon United FCβ. It was confident, detailed, and 100% hallucinated.β
When to Use MCP?
MCP = LLM lifeline when models hallucinate most.
What is MCP?
Model Context Protocol (MCP) = Standardized way for LLMs to discover and call your external tools/data.
model-context-protocol
Open Banking MCP: Compare Bank Rates in Your AI Assistant
Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...
Where MCP Shines
βSingle LLMs hallucinate. Multiβagent systems multiply the problem.β
MCP: 5 Leadership Lessons
From hype to control. Here are the 5 truths every CTO must know.
How MCP Works?
βMCP handshake β tool call β your code runs. 3 minutes to understand.β
Why MCP?
βLast week my LLM swore the 2024 World Cup winner was βMoon United FCβ. It was confident, detailed, and 100% hallucinated.β
When to Use MCP?
MCP = LLM lifeline when models hallucinate most.
What is MCP?
Model Context Protocol (MCP) = Standardized way for LLMs to discover and call your external tools/data.
qa
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
Navigating the Tempest: QA in the Age of Hyper-Driven Development
Written by - Dennis Nyawira
As a Dev π¨βπ», why you should be better friends with QA β€οΈ
Written by - Millan Kaul
How to win dev friends as a QA π€
Written by - Millan Kaul
AI-ML
How AI Agents Actually Collaborate: Real-World Workflows, Protocols, and Pitfalls
Written by - Millan Kaul
5 Well-Known and 5 Less-Known MCP Concepts with Examples
Written by - Millan Kaul
15 AI terms related or similar to MCP (Model Context Protocol) and Agent
Written by - Millan Kaul
20 AI acronyms and keywords with definitions and use cases
Written by - Millan Kaul
10 Foundational AI Building Block Concepts for Testers and Developers
Written by - Millan Kaul
A live implementation of a chatbot
Written by - Millan Kaul
Roadmap
The paradigm of Quality - Optimised
Written by - Alejandro Sanchez Giraldo , ChatGPT , Gith...
The paradigm of Quality - Built-In
Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...
The paradigm of Quality - Embedded
Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...
Two Timeless Concepts
Written by - Alejandro Sanchez Giraldo and ChatGPT
The paradigm of Quality
Written by - Alejandro Sanchez Giraldo and ChatGPT
Quality Engineering
The paradigm of Quality - Optimised
Written by - Alejandro Sanchez Giraldo , ChatGPT , Gith...
The paradigm of Quality - Built-In
Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...
The paradigm of Quality - Embedded
Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...
Two Timeless Concepts
Written by - Alejandro Sanchez Giraldo and ChatGPT
The paradigm of Quality
Written by - Alejandro Sanchez Giraldo and ChatGPT
Strategy
The paradigm of Quality - Optimised
Written by - Alejandro Sanchez Giraldo , ChatGPT , Gith...
The paradigm of Quality - Built-In
Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...
The paradigm of Quality - Embedded
Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...
Two Timeless Concepts
Written by - Alejandro Sanchez Giraldo and ChatGPT
The paradigm of Quality
Written by - Alejandro Sanchez Giraldo and ChatGPT
Maturity Assessment
The paradigm of Quality - Optimised
Written by - Alejandro Sanchez Giraldo , ChatGPT , Gith...
The paradigm of Quality - Built-In
Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...
The paradigm of Quality - Embedded
Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...
Two Timeless Concepts
Written by - Alejandro Sanchez Giraldo and ChatGPT
The paradigm of Quality
Written by - Alejandro Sanchez Giraldo and ChatGPT
evals
I turned a defect into an eval - day 15
I found one AI bug todayβand turned it into a permanent test in 10 minutes.
I put a price tag on quality - day 10
I tested two models today. One answer was only slightly better and much more expensive.
I tested the βboringβ requirement - day 05
Putting predictable constraints and standard expectations to the test, evaluating how the LLM judge grades standard formatting and basic rules.
My first AI eval was boring - day 02
Setting up a basic LLM evaluation only to find the initial results predictable, but discovering why simple tests are the best place to start.
The same prompt, 10 different answers - day 01
Running the exact same prompt multiple times reveals the inherent variability in LLM responses, a core challenge in AI testing.
llm-as-a-judge
I turned a defect into an eval - day 15
I found one AI bug todayβand turned it into a permanent test in 10 minutes.
I put a price tag on quality - day 10
I tested two models today. One answer was only slightly better and much more expensive.
I tested the βboringβ requirement - day 05
Putting predictable constraints and standard expectations to the test, evaluating how the LLM judge grades standard formatting and basic rules.
My first AI eval was boring - day 02
Setting up a basic LLM evaluation only to find the initial results predictable, but discovering why simple tests are the best place to start.
The same prompt, 10 different answers - day 01
Running the exact same prompt multiple times reveals the inherent variability in LLM responses, a core challenge in AI testing.
llm-evals
I turned a defect into an eval - day 15
I found one AI bug todayβand turned it into a permanent test in 10 minutes.
I put a price tag on quality - day 10
I tested two models today. One answer was only slightly better and much more expensive.
I tested the βboringβ requirement - day 05
Putting predictable constraints and standard expectations to the test, evaluating how the LLM judge grades standard formatting and basic rules.
My first AI eval was boring - day 02
Setting up a basic LLM evaluation only to find the initial results predictable, but discovering why simple tests are the best place to start.
The same prompt, 10 different answers - day 01
Running the exact same prompt multiple times reveals the inherent variability in LLM responses, a core challenge in AI testing.
javascript
A live implementation of a chatbot
Written by - Millan Kaul
What is π»ππΊ βοΈβ-βββ₯β ππ¬π in 5 minutesΒ !
Written by - Millan Kaul
How to handle 404, 500 and moreβ-βusing fetch()API in JavaScript
Written by - Millan Kaul
Running a local server and API testing in less than 10 minutes
Written by - Millan Kaul
api
API testing with nightwatch in 15 mins
Written by - Millan Kaul
Run your first RESTful API service using docker
Written by - Millan Kaul
How to handle 404, 500 and moreβ-βusing fetch()API in JavaScript
Written by - Millan Kaul
Is Open Banking just another APIβ
Written by - Millan Kaul
docker
Saving 216 Minutes in 2.5 Years with Simple Docker Enhancements
How three minor Docker configuration changes shaved 33% off my Jekyll build times, saving hours of developer wait time.
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
How I turned my blog into a Docker based development paradise π³ - Try It Yourself!
Written by - Millan Kaul
Run your first RESTful API service using docker
Written by - Millan Kaul
AI Fundamentals
5 Well-Known and 5 Less-Known MCP Concepts with Examples
Written by - Millan Kaul
15 AI terms related or similar to MCP (Model Context Protocol) and Agent
Written by - Millan Kaul
20 AI acronyms and keywords with definitions and use cases
Written by - Millan Kaul
10 Foundational AI Building Block Concepts for Testers and Developers
Written by - Millan Kaul
Agentic
How AI Agents Actually Collaborate: Real-World Workflows, Protocols, and Pitfalls
Written by - Millan Kaul
5 Well-Known and 5 Less-Known MCP Concepts with Examples
Written by - Millan Kaul
15 AI terms related or similar to MCP (Model Context Protocol) and Agent
Written by - Millan Kaul
20 AI acronyms and keywords with definitions and use cases
Written by - Millan Kaul
prompt-engineering
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing
Written by - Millan Kaul
quality-engineering
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
node
What is π»ππΊ βοΈβ-βββ₯β ππ¬π in 5 minutesΒ !
Written by - Millan Kaul
How to handle 404, 500 and moreβ-βusing fetch()API in JavaScript
Written by - Millan Kaul
Running a local server and API testing in less than 10 minutes
Written by - Millan Kaul
tools
Base64 decoding usingΒ Postman
Written by - Millan Kaul
Installing and running Postman app on linux (REHL 8.x)
Written by - Millan Kaul
How to decode JSON Web Token (JWT) offline
Written by - Millan Kaul
quality engineering
The Hidden Cost of Quality Debt: What Leadership Doesnβt See
Written by - Gavin Cheung
The API Automation framework I wish I had known sooner
Written by - Millan Kaul
2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM
Written by - Millan Kaul
llm-tools
Where MCP Shines
βSingle LLMs hallucinate. Multiβagent systems multiply the problem.β
Why MCP?
βLast week my LLM swore the 2024 World Cup winner was βMoon United FCβ. It was confident, detailed, and 100% hallucinated.β
What is MCP?
Model Context Protocol (MCP) = Standardized way for LLMs to discover and call your external tools/data.
transformers
Transformer Architecture: The Engine Behind Every LLM
Written by - Millan Kaul
Attention Mechanism: How LLMs Decide βWhat Matters Mostβ
Written by - Millan Kaul
What is an LLM - Large Language Model ?
Written by - Millan Kaul
guardrails
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
ai-native
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
spec-driven-development
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
human-in-the-loop
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
security
Base64 decoding usingΒ Postman
Written by - Millan Kaul
How to decode JSON Web Token (JWT) offline
Written by - Millan Kaul
dev
As a Dev π¨βπ», why you should be better friends with QA β€οΈ
Written by - Millan Kaul
How to win dev friends as a QA π€
Written by - Millan Kaul
tutorial
Guide to implement Multi-tab Code Snippets in Jekyll π§ͺ
Written by - Millan Kaul
Installing and running Postman app on linux (REHL 8.x)
Written by - Millan Kaul
ai
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
Evolution of Reliability Tester and AI testing
Written by - Karthik Hariharan
api-testing
The API Automation framework I wish I had known sooner
Written by - Millan Kaul
API testing with nightwatch in 15 mins
Written by - Millan Kaul
engineering
The API Automation framework I wish I had known sooner
Written by - Millan Kaul
Exponential backoff strategy - explained with {code}
Written by - Millan Kaul
Shift-Left
Importance of Test Data - with code example
Written by - Millan Kaul
Say hello to Multiple : New Performance testing tool
Written by - Millan Kaul
Testing
10 Foundational AI Building Block Concepts for Testers and Developers
Written by - Millan Kaul
WebDriver Saga
Written by - Neelam Pal
Automation
The Ultimate guide to complex JSON parsing using JavaScript, Python, Go, and Java
Written by - Millan Kaul
Importance of Test Data - with code example
Written by - Millan Kaul
Test Data
The Ultimate guide to complex JSON parsing using JavaScript, Python, Go, and Java
Written by - Millan Kaul
Importance of Test Data - with code example
Written by - Millan Kaul
leadership
The Hidden Cost of Quality Debt: What Leadership Doesnβt See
Written by - Gavin Cheung
Choosing between : Speed, Quality, Cost - in Test Automation
Written by - Millan Kaul
test automation
2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM
Written by - Millan Kaul
Choosing between : Speed, Quality, Cost - in Test Automation
Written by - Millan Kaul
Enterprise Testing
QE Leadership at 3 stage of org, your blueprint for QE Success
The most successful QE leaders donβt just enforce qualityβthey cultivate that environmentβ¦
How to Successfully collaborate with multiple Test Leads in a Large-Scale Projects
Master the art of collaborating with multiple QA leads in enterprise projects. Learn effective strategies for test coordination, risk management and successf...
MCP
5 Well-Known and 5 Less-Known MCP Concepts with Examples
Written by - Millan Kaul
15 AI terms related or similar to MCP (Model Context Protocol) and Agent
Written by - Millan Kaul
ai-architecture
When to Use MCP?
MCP = LLM lifeline when models hallucinate most.
What is MCP?
Model Context Protocol (MCP) = Standardized way for LLMs to discover and call your external tools/data.
developer-tools
Why MCP?
βLast week my LLM swore the 2024 World Cup winner was βMoon United FCβ. It was confident, detailed, and 100% hallucinated.β
What is MCP?
Model Context Protocol (MCP) = Standardized way for LLMs to discover and call your external tools/data.
llm-reliability
LLM Hallucinations: Why Models Invent Facts Confidently
Written by - Millan Kaul
When to Use MCP?
MCP = LLM lifeline when models hallucinate most.
llm-evaluation
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
model-evaluation
Spec-Driven Development: QAβs North Star in AI-Native Teams
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
QA Toolbox: Powering Reliable AI Outputs
QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.
software-architecture
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
serverless
Running a local server and API testing in less than 10 minutes
Written by - Millan Kaul
welcome
Welcome to #QualityWithMillan
Welcome to #QualityWithMillan !
openBanking
Is Open Banking just another APIβ
Written by - Millan Kaul
banking
Is Open Banking just another APIβ
Written by - Millan Kaul
CDR
Is Open Banking just another APIβ
Written by - Millan Kaul
dataSharing
Is Open Banking just another APIβ
Written by - Millan Kaul
fintech
Is Open Banking just another APIβ
Written by - Millan Kaul
finance
Is Open Banking just another APIβ
Written by - Millan Kaul
algorithm
How to decode JSON Web Token (JWT) offline
Written by - Millan Kaul
team work
How to win dev friends as a QA π€
Written by - Millan Kaul
nvm
What is π»ππΊ βοΈβ-βββ₯β ππ¬π in 5 minutesΒ !
Written by - Millan Kaul
linux
Installing and running Postman app on linux (REHL 8.x)
Written by - Millan Kaul
SoftwareTesting
Leading by Example: The Power of a Strong Software Testing Leader
Written by - Millan Kaul
Leadership
Leading by Example: The Power of a Strong Software Testing Leader
Written by - Millan Kaul
TestingLeadership
Leading by Example: The Power of a Strong Software Testing Leader
Written by - Millan Kaul
QualityAssurance
Leading by Example: The Power of a Strong Software Testing Leader
Written by - Millan Kaul
code
7 most used util and helper methods in test automation project
Written by - Millan Kaul
shift-left
How to Shift-Left without writing Code π©βπ»
Written by - Millan Kaul
qualityAndTesting
How to Shift-Left without writing Code π©βπ»
Written by - Millan Kaul
collaboration
How to Shift-Left without writing Code π©βπ»
Written by - Millan Kaul
EarlyFeedback
How to Shift-Left without writing Code π©βπ»
Written by - Millan Kaul
microservices
Run your first RESTful API service using docker
Written by - Millan Kaul
development
Run your first RESTful API service using docker
Written by - Millan Kaul
java
Run your first RESTful API service using docker
Written by - Millan Kaul
nightwatch
API testing with nightwatch in 15 mins
Written by - Millan Kaul
end-to-end
API testing with nightwatch in 15 mins
Written by - Millan Kaul
automated-testing
API testing with nightwatch in 15 mins
Written by - Millan Kaul
javaScript
API testing with nightwatch in 15 mins
Written by - Millan Kaul
e2e
API testing with nightwatch in 15 mins
Written by - Millan Kaul
grad
Starting My Corporate Journey: working as an intern/graduate
Written by - Jing Deng
intern
Starting My Corporate Journey: working as an intern/graduate
Written by - Jing Deng
uni
Starting My Corporate Journey: working as an intern/graduate
Written by - Jing Deng
career
Starting My Corporate Journey: working as an intern/graduate
Written by - Jing Deng
personal
Starting My Corporate Journey: working as an intern/graduate
Written by - Jing Deng
experience
Starting My Corporate Journey: working as an intern/graduate
Written by - Jing Deng
quality
A tasty analogy: Quality and testing explained like a piece of cake π°
Written by - Millan Kaul
usertesting
A/B Tetsing - in 5 steps
Written by - Millan Kaul
alpha
A/B Tetsing - in 5 steps
Written by - Millan Kaul
beta
A/B Tetsing - in 5 steps
Written by - Millan Kaul
appium
Easiest way to understand How Appium works
Written by - Millan Kaul
mobile-automation
Easiest way to understand How Appium works
Written by - Millan Kaul
performance-testing
k6 - web dashboards + HTML report π
Written by - Millan Kaul
k6
k6 - web dashboards + HTML report π
Written by - Millan Kaul
html-reporting
k6 - web dashboards + HTML report π
Written by - Millan Kaul
blog
How I turned my blog into a Docker based development paradise π³ - Try It Yourself!
Written by - Millan Kaul
Jekyll
How I turned my blog into a Docker based development paradise π³ - Try It Yourself!
Written by - Millan Kaul
Shift-Left & Right
Navigating the Tempest: QA in the Age of Hyper-Driven Development
Written by - Dennis Nyawira
Agile Testing
Navigating the Tempest: QA in the Age of Hyper-Driven Development
Written by - Dennis Nyawira
archialgorithm
Exponential backoff strategy - explained with {code}
Written by - Millan Kaul
performance testing
Say hello to Multiple : New Performance testing tool
Written by - Millan Kaul
Test automation
Say hello to Multiple : New Performance testing tool
Written by - Millan Kaul
selenium
WebDriver Saga
Written by - Neelam Pal
webdriver
WebDriver Saga
Written by - Neelam Pal
json
The Ultimate guide to complex JSON parsing using JavaScript, Python, Go, and Java
Written by - Millan Kaul
strategic
Choosing between : Speed, Quality, Cost - in Test Automation
Written by - Millan Kaul
2024-reflection
2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM
Written by - Millan Kaul
quality assurance
2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM
Written by - Millan Kaul
QA
2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM
Written by - Millan Kaul
automation testing
2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM
Written by - Millan Kaul
SDETs
2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM
Written by - Millan Kaul
Test Leadership
How to Successfully collaborate with multiple Test Leads in a Large-Scale Projects
Master the art of collaborating with multiple QA leads in enterprise projects. Learn effective strategies for test coordination, risk management and successf...
Project Management
How to Successfully collaborate with multiple Test Leads in a Large-Scale Projects
Master the art of collaborating with multiple QA leads in enterprise projects. Learn effective strategies for test coordination, risk management and successf...
QA Strategy
How to Successfully collaborate with multiple Test Leads in a Large-Scale Projects
Master the art of collaborating with multiple QA leads in enterprise projects. Learn effective strategies for test coordination, risk management and successf...
Team Collaboration
How to Successfully collaborate with multiple Test Leads in a Large-Scale Projects
Master the art of collaborating with multiple QA leads in enterprise projects. Learn effective strategies for test coordination, risk management and successf...
Quality Engineering Leadership
QE Leadership at 3 stage of org, your blueprint for QE Success
The most successful QE leaders donβt just enforce qualityβthey cultivate that environmentβ¦
QE
QE Leadership at 3 stage of org, your blueprint for QE Success
The most successful QE leaders donβt just enforce qualityβthey cultivate that environmentβ¦
Start up
QE Leadership at 3 stage of org, your blueprint for QE Success
The most successful QE leaders donβt just enforce qualityβthey cultivate that environmentβ¦
Collaboration
QE Leadership at 3 stage of org, your blueprint for QE Success
The most successful QE leaders donβt just enforce qualityβthey cultivate that environmentβ¦
testing-at-scale
The API Automation framework I wish I had known sooner
Written by - Millan Kaul
cicd
The API Automation framework I wish I had known sooner
Written by - Millan Kaul
type-script
The API Automation framework I wish I had known sooner
Written by - Millan Kaul
readme
The API Automation framework I wish I had known sooner
Written by - Millan Kaul
chatbot
A live implementation of a chatbot
Written by - Millan Kaul
Developers
10 Foundational AI Building Block Concepts for Testers and Developers
Written by - Millan Kaul
Data Science
20 AI acronyms and keywords with definitions and use cases
Written by - Millan Kaul
Agents
How AI Agents Actually Collaborate: Real-World Workflows, Protocols, and Pitfalls
Written by - Millan Kaul
A2A
How AI Agents Actually Collaborate: Real-World Workflows, Protocols, and Pitfalls
Written by - Millan Kaul
conference
My global speaking journey at Tech Conferences & Meetups in 2025
Written by - Millan Kaul
speaking
My global speaking journey at Tech Conferences & Meetups in 2025
Written by - Millan Kaul
meetups
My global speaking journey at Tech Conferences & Meetups in 2025
Written by - Millan Kaul
Keynote
My global speaking journey at Tech Conferences & Meetups in 2025
Written by - Millan Kaul
Topmate
My global speaking journey at Tech Conferences & Meetups in 2025
Written by - Millan Kaul
Mentoring
My global speaking journey at Tech Conferences & Meetups in 2025
Written by - Millan Kaul
tool-calling
When to Use MCP?
MCP = LLM lifeline when models hallucinate most.
ai-reliability
Why MCP?
βLast week my LLM swore the 2024 World Cup winner was βMoon United FCβ. It was confident, detailed, and 100% hallucinated.β
sdet
Why MCP?
βLast week my LLM swore the 2024 World Cup winner was βMoon United FCβ. It was confident, detailed, and 100% hallucinated.β
playwright-mcp
How MCP Works?
βMCP handshake β tool call β your code runs. 3 minutes to understand.β
mcp-tools
How MCP Works?
βMCP handshake β tool call β your code runs. 3 minutes to understand.β
vscode-mcp
How MCP Works?
βMCP handshake β tool call β your code runs. 3 minutes to understand.β
coding-assistant
How MCP Works?
βMCP handshake β tool call β your code runs. 3 minutes to understand.β
ai-leadership
MCP: 5 Leadership Lessons
From hype to control. Here are the 5 truths every CTO must know.
cto
MCP: 5 Leadership Lessons
From hype to control. Here are the 5 truths every CTO must know.
ai-governance
MCP: 5 Leadership Lessons
From hype to control. Here are the 5 truths every CTO must know.
multi-agent
Where MCP Shines
βSingle LLMs hallucinate. Multiβagent systems multiply the problem.β
agentic-workflows
Where MCP Shines
βSingle LLMs hallucinate. Multiβagent systems multiply the problem.β
autonomous-agents
Where MCP Shines
βSingle LLMs hallucinate. Multiβagent systems multiply the problem.β
large-language-model
What is an LLM - Large Language Model ?
Written by - Millan Kaul
ai-for-testers
What is an LLM - Large Language Model ?
Written by - Millan Kaul
tokenization
What is Tokenization? How LLMs See Your Text
Written by - Millan Kaul
llm-prompts
What is Tokenization? How LLMs See Your Text
Written by - Millan Kaul
context-window
What is Tokenization? How LLMs See Your Text
Written by - Millan Kaul
llm-costs
What is Tokenization? How LLMs See Your Text
Written by - Millan Kaul
embeddings
Word Embeddings: How AI Understands βSimilar Meaningβ
Written by - Millan Kaul
word-vectors
Word Embeddings: How AI Understands βSimilar Meaningβ
Written by - Millan Kaul
semantic-search
Word Embeddings: How AI Understands βSimilar Meaningβ
Written by - Millan Kaul
vector-databases
Word Embeddings: How AI Understands βSimilar Meaningβ
Written by - Millan Kaul
attention-mechanism
Attention Mechanism: How LLMs Decide βWhat Matters Mostβ
Written by - Millan Kaul
self-attention
Attention Mechanism: How LLMs Decide βWhat Matters Mostβ
Written by - Millan Kaul
llm-prompting
Attention Mechanism: How LLMs Decide βWhat Matters Mostβ
Written by - Millan Kaul
transformer-architecture
Transformer Architecture: The Engine Behind Every LLM
Written by - Millan Kaul
attention-layers
Transformer Architecture: The Engine Behind Every LLM
Written by - Millan Kaul
llm-internals
Transformer Architecture: The Engine Behind Every LLM
Written by - Millan Kaul
pre-training
LLM Pre-training: Learning From Trillions of Words
Written by - Millan Kaul
next-token-prediction
LLM Pre-training: Learning From Trillions of Words
Written by - Millan Kaul
masked-language-modeling
LLM Pre-training: Learning From Trillions of Words
Written by - Millan Kaul
llm-training
LLM Pre-training: Learning From Trillions of Words
Written by - Millan Kaul
fine-tuning
LLM Fine-tuning: Customize Powerful Models for Your Needs
Written by - Millan Kaul
lora-peft
LLM Fine-tuning: Customize Powerful Models for Your Needs
Written by - Millan Kaul
supervised-fine-tuning
LLM Fine-tuning: Customize Powerful Models for Your Needs
Written by - Millan Kaul
llm-customization
LLM Fine-tuning: Customize Powerful Models for Your Needs
Written by - Millan Kaul
zero-shot
Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing
Written by - Millan Kaul
few-shot
Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing
Written by - Millan Kaul
prompting
Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing
Written by - Millan Kaul
generative-ai
Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing
Written by - Millan Kaul
hallucination
LLM Hallucinations: Why Models Invent Facts Confidently
Written by - Millan Kaul
llm-safety
LLM Hallucinations: Why Models Invent Facts Confidently
Written by - Millan Kaul
fact-checking
LLM Hallucinations: Why Models Invent Facts Confidently
Written by - Millan Kaul
open-banking
Open Banking MCP: Compare Bank Rates in Your AI Assistant
Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...
australian-cdr
Open Banking MCP: Compare Bank Rates in Your AI Assistant
Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...
ai-assistant
Open Banking MCP: Compare Bank Rates in Your AI Assistant
Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...
banking-automation
Open Banking MCP: Compare Bank Rates in Your AI Assistant
Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...
claude
Open Banking MCP: Compare Bank Rates in Your AI Assistant
Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...
cursor
Open Banking MCP: Compare Bank Rates in Your AI Assistant
Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...
constitution-md
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
test-strategy
constitution.md in Spec-Driven Development
Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.
ai-agents
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
test-harness
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
harness-engineering
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
continuous-testing
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
regression-testing
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
agent-reliability
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
qa-for-ai
Why AI Agents Need a Test Harness
AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...
machine-learning
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
ml-pipeline
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
data-engineering
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
model-training
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
model-monitoring
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
mlops
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
reproducibility
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
feature-engineering
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
deployment
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
data-drift
Machine Learning Pipelines: The Backbone of Reliable AI Systems
An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.
rag
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
ollama
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
qdrant
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
python
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
langchain
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
ragas
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
local-ai
How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python
Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.
jekyll
Saving 216 Minutes in 2.5 Years with Simple Docker Enhancements
How three minor Docker configuration changes shaved 33% off my Jekyll build times, saving hours of developer wait time.
devops
Saving 216 Minutes in 2.5 Years with Simple Docker Enhancements
How three minor Docker configuration changes shaved 33% off my Jekyll build times, saving hours of developer wait time.
productivity
Saving 216 Minutes in 2.5 Years with Simple Docker Enhancements
How three minor Docker configuration changes shaved 33% off my Jekyll build times, saving hours of developer wait time.
jeklly
Guide to implement Multi-tab Code Snippets in Jekyll π§ͺ
Written by - Millan Kaul
GitHub pages
Guide to implement Multi-tab Code Snippets in Jekyll π§ͺ
Written by - Millan Kaul
multi-code tabs
Guide to implement Multi-tab Code Snippets in Jekyll π§ͺ
Written by - Millan Kaul