All categories

• blog 69
• ai 12
• engineering 9
• article 8
• llm-foundations 8
• ai-tools 7
• mcp 6
• quality-engineering 5
• tutorial 3
• Leadership 2
• tools 1
• coding 1
• leadership 1
• ai-strategy 1
• agents 1
• llm-advanced 1
• fintech 1

blog

How to test the ai llm judge - day 07

August 30, 2026 less than 1 minute read

Evaluating the evaluator: why your LLM-as-a-judge is a system under test that needs its own validation.

I made AI Judge - Day 06

August 29, 2026 less than 1 minute read

Evaluating the logic behind having an LLM judge another LLM’s output. Establishing a helpfulness rubric and confronting definitions.

I tested the ‘boring’ requirement - day 05

August 28, 2026 less than 1 minute read

Putting predictable constraints and standard expectations to the test, evaluating how the LLM judge grades standard formatting and basic rules.

Five examples are enough to start - day 04

August 27, 2026 less than 1 minute read

You don’t need thousands of test cases to begin. Five carefully chosen examples are more than enough to boot up your AI evaluation pipeline.

I tested a longer prompt - day 03

August 26, 2026 less than 1 minute read

Increasing the complexity of prompt inputs to see how the LLM judge responds and analyzing its limits when prompt length grows.

My first AI eval was boring - day 02

August 25, 2026 less than 1 minute read

Setting up a basic LLM evaluation only to find the initial results predictable, but discovering why simple tests are the best place to start.

The same prompt, 10 different answers - day 01

August 24, 2026 less than 1 minute read

Running the exact same prompt multiple times reveals the inherent variability in LLM responses, a core challenge in AI testing.

Guide to implement Multi-tab Code Snippets in Jekyll 🧪

August 11, 2026 1 minute read

Written by - Millan Kaul

Saving 216 Minutes in 2.5 Years with Simple Docker Enhancements

August 5, 2026 2 minute read

How three minor Docker configuration changes shaved 33% off my Jekyll build times, saving hours of developer wait time.

How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python

August 5, 2026 1 minute read

Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.

Machine Learning Pipelines: The Backbone of Reliable AI Systems

May 17, 2026 3 minute read

An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.

Why AI Agents Need a Test Harness

May 14, 2026 4 minute read

AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...

constitution.md in Spec-Driven Development

May 13, 2026 3 minute read

Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.

Spec-Driven Development: QA’s North Star in AI-Native Teams

May 12, 2026 1 minute read

QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.

QA Toolbox: Powering Reliable AI Outputs

May 11, 2026 2 minute read

QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.

Open Banking MCP: Compare Bank Rates in Your AI Assistant

May 1, 2026 2 minute read

Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...

LLM Hallucinations: Why Models Invent Facts Confidently

April 10, 2026 2 minute read

Written by - Millan Kaul

Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing

April 9, 2026 3 minute read

Written by - Millan Kaul

LLM Fine-tuning: Customize Powerful Models for Your Needs

April 8, 2026 3 minute read

Written by - Millan Kaul

LLM Pre-training: Learning From Trillions of Words

April 7, 2026 2 minute read

Written by - Millan Kaul

Transformer Architecture: The Engine Behind Every LLM

April 6, 2026 2 minute read

Written by - Millan Kaul

Attention Mechanism: How LLMs Decide ‘What Matters Most’

April 5, 2026 3 minute read

Written by - Millan Kaul

Word Embeddings: How AI Understands ‘Similar Meaning’

April 4, 2026 3 minute read

Written by - Millan Kaul

What is Tokenization? How LLMs See Your Text

April 3, 2026 4 minute read

Written by - Millan Kaul

What is an LLM - Large Language Model ?

March 29, 2026 4 minute read

Written by - Millan Kaul

Where MCP Shines

February 10, 2026 less than 1 minute read

“Single LLMs hallucinate. Multi‑agent systems multiply the problem.”

MCP: 5 Leadership Lessons

February 7, 2026 1 minute read

From hype to control. Here are the 5 truths every CTO must know.

How MCP Works?

February 5, 2026 1 minute read

“MCP handshake → tool call → your code runs. 3 minutes to understand.”

Why MCP?

February 3, 2026 1 minute read

“Last week my LLM swore the 2024 World Cup winner was ‘Moon United FC’. It was confident, detailed, and 100% hallucinated.”

When to Use MCP?

January 31, 2026 1 minute read

MCP = LLM lifeline when models hallucinate most.

What is MCP?

January 24, 2026 1 minute read

Model Context Protocol (MCP) = Standardized way for LLMs to discover and call your external tools/data.

My global speaking journey at Tech Conferences & Meetups in 2025

December 14, 2025 5 minute read

Written by - Millan Kaul

The Hidden Cost of Quality Debt: What Leadership Doesn’t See

November 21, 2025 9 minute read

Written by - Gavin Cheung

How AI Agents Actually Collaborate: Real-World Workflows, Protocols, and Pitfalls

November 11, 2025 2 minute read

Written by - Millan Kaul

5 Well-Known and 5 Less-Known MCP Concepts with Examples

November 10, 2025 1 minute read

Written by - Millan Kaul

15 AI terms related or similar to MCP (Model Context Protocol) and Agent

November 9, 2025 2 minute read

Written by - Millan Kaul

20 AI acronyms and keywords with definitions and use cases

November 8, 2025 2 minute read

Written by - Millan Kaul

10 Foundational AI Building Block Concepts for Testers and Developers

November 7, 2025 1 minute read

Written by - Millan Kaul

A live implementation of a chatbot

July 12, 2025 1 minute read

Written by - Millan Kaul

The API Automation framework I wish I had known sooner

February 22, 2025 3 minute read

Written by - Millan Kaul

2024 in Review: QA, AI and Quality Engineering in Reflection at #QWM

December 25, 2024 3 minute read

Written by - Millan Kaul

Choosing between : Speed, Quality, Cost - in Test Automation

November 11, 2024 3 minute read

Written by - Millan Kaul

The Ultimate guide to complex JSON parsing using JavaScript, Python, Go, and Java

October 16, 2024 2 minute read

Written by - Millan Kaul

Importance of Test Data - with code example

September 14, 2024 2 minute read

Written by - Millan Kaul

WebDriver Saga

April 24, 2024 2 minute read

Written by - Neelam Pal

Say hello to Multiple : New Performance testing tool

April 6, 2024 4 minute read

Written by - Millan Kaul

Exponential backoff strategy - explained with {code}

April 1, 2024 3 minute read

Written by - Millan Kaul

Navigating the Tempest: QA in the Age of Hyper-Driven Development

March 22, 2024 2 minute read

Written by - Dennis Nyawira

Starting My Corporate Journey: working as an intern/graduate

July 16, 2023 7 minute read

Written by - Jing Deng

How to Shift-Left without writing Code 👩‍💻

June 3, 2023 5 minute read

Written by - Millan Kaul

The paradigm of Quality - Optimised

May 1, 2023 12 minute read

Written by - Alejandro Sanchez Giraldo , ChatGPT , Gith...

7 most used util and helper methods in test automation project

April 6, 2023 2 minute read

Written by - Millan Kaul

The paradigm of Quality - Built-In

April 1, 2023 5 minute read

Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...

The paradigm of Quality - Embedded

March 1, 2023 11 minute read

Written by - Alejandro Sanchez Giraldo , ChatGPT and Gi...

Evolution of Reliability Tester and AI testing

February 24, 2023 1 minute read

Written by - Karthik Hariharan

Base64 decoding using Postman

February 21, 2023 2 minute read

Written by - Millan Kaul

Two Timeless Concepts

February 14, 2023 2 minute read

Written by - Alejandro Sanchez Giraldo and ChatGPT

The paradigm of Quality

February 8, 2023 5 minute read

Written by - Alejandro Sanchez Giraldo and ChatGPT

Leading by Example: The Power of a Strong Software Testing Leader

February 1, 2023 1 minute read

Written by - Millan Kaul

Exploratory Testing 🔎 + Automation ⚙️

January 27, 2023 3 minute read

Written by - Millan Kaul

As a Dev 👨‍💻, why you should be better friends with QA ❤️

January 22, 2023 5 minute read

Written by - Millan Kaul

Plus Ca Change in Test Automation

January 20, 2023 5 minute read

Written by - Paul Maxwell-Walters

Installing and running Postman app on linux (REHL 8.x)

January 20, 2023 3 minute read

Written by - Millan Kaul

What is 𝗻𝘃𝗺 ❓️ - ⓝⓥⓜ 𝟭𝟬𝟭 in 5 minutes !

January 12, 2023 1 minute read

Written by - Millan Kaul

How to win dev friends as a QA 🤝

January 11, 2023 2 minute read

Written by - Millan Kaul

Love-Hate Relationship with Selenium Automation

January 9, 2023 1 minute read

Written by - Millan Kaul

How to handle 404, 500 and more - using fetch()API in JavaScript

January 7, 2023 6 minute read

Written by - Millan Kaul

How to decode JSON Web Token (JWT) offline

January 6, 2023 less than 1 minute read

Written by - Millan Kaul

Welcome to #QualityWithMillan

December 17, 2021 less than 1 minute read

Welcome to #QualityWithMillan !

Back to top ↑

ai

How to test the ai llm judge - day 07

August 30, 2026 less than 1 minute read

Evaluating the evaluator: why your LLM-as-a-judge is a system under test that needs its own validation.

I made AI Judge - Day 06

August 29, 2026 less than 1 minute read

Evaluating the logic behind having an LLM judge another LLM’s output. Establishing a helpfulness rubric and confronting definitions.

I tested the ‘boring’ requirement - day 05

August 28, 2026 less than 1 minute read

Putting predictable constraints and standard expectations to the test, evaluating how the LLM judge grades standard formatting and basic rules.

Five examples are enough to start - day 04

August 27, 2026 less than 1 minute read

You don’t need thousands of test cases to begin. Five carefully chosen examples are more than enough to boot up your AI evaluation pipeline.

I tested a longer prompt - day 03

August 26, 2026 less than 1 minute read

Increasing the complexity of prompt inputs to see how the LLM judge responds and analyzing its limits when prompt length grows.

My first AI eval was boring - day 02

August 25, 2026 less than 1 minute read

Setting up a basic LLM evaluation only to find the initial results predictable, but discovering why simple tests are the best place to start.

The same prompt, 10 different answers - day 01

August 24, 2026 less than 1 minute read

Running the exact same prompt multiple times reveals the inherent variability in LLM responses, a core challenge in AI testing.

Machine Learning Pipelines: The Backbone of Reliable AI Systems

May 17, 2026 3 minute read

An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.

Why AI Agents Need a Test Harness

May 14, 2026 4 minute read

AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...

constitution.md in Spec-Driven Development

May 13, 2026 3 minute read

Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.

Spec-Driven Development: QA’s North Star in AI-Native Teams

May 12, 2026 1 minute read

QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.

QA Toolbox: Powering Reliable AI Outputs

May 11, 2026 2 minute read

QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.

Back to top ↑

engineering

How to test the ai llm judge - day 07

August 30, 2026 less than 1 minute read

Evaluating the evaluator: why your LLM-as-a-judge is a system under test that needs its own validation.

I made AI Judge - Day 06

August 29, 2026 less than 1 minute read

Evaluating the logic behind having an LLM judge another LLM’s output. Establishing a helpfulness rubric and confronting definitions.

I tested the ‘boring’ requirement - day 05

August 28, 2026 less than 1 minute read

Putting predictable constraints and standard expectations to the test, evaluating how the LLM judge grades standard formatting and basic rules.

Five examples are enough to start - day 04

August 27, 2026 less than 1 minute read

You don’t need thousands of test cases to begin. Five carefully chosen examples are more than enough to boot up your AI evaluation pipeline.

I tested a longer prompt - day 03

August 26, 2026 less than 1 minute read

Increasing the complexity of prompt inputs to see how the LLM judge responds and analyzing its limits when prompt length grows.

My first AI eval was boring - day 02

August 25, 2026 less than 1 minute read

Setting up a basic LLM evaluation only to find the initial results predictable, but discovering why simple tests are the best place to start.

The same prompt, 10 different answers - day 01

August 24, 2026 less than 1 minute read

Running the exact same prompt multiple times reveals the inherent variability in LLM responses, a core challenge in AI testing.

Saving 216 Minutes in 2.5 Years with Simple Docker Enhancements

August 5, 2026 2 minute read

How three minor Docker configuration changes shaved 33% off my Jekyll build times, saving hours of developer wait time.

How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python

August 5, 2026 1 minute read

Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.

Back to top ↑

article

How I turned my blog into a Docker based development paradise 🐳 - Try It Yourself!

February 28, 2024 2 minute read

Written by - Millan Kaul

k6 - web dashboards + HTML report 📊

January 29, 2024 2 minute read

Written by - Millan Kaul

Easiest way to understand How Appium works

January 8, 2024 3 minute read

Written by - Millan Kaul

A/B Tetsing - in 5 steps

August 27, 2023 3 minute read

Written by - Millan Kaul

A tasty analogy: Quality and testing explained like a piece of cake 🍰

July 30, 2023 1 minute read

Written by - Millan Kaul

Is Open Banking just another API❓

January 1, 2023 3 minute read

Written by - Millan Kaul

Why test automation will be key focus in 2023 ?

December 24, 2022 2 minute read

Written by - Millan Kaul

5 misconceptions regarding Test Automation

September 9, 2021 3 minute read

Written by - Millan Kaul

Back to top ↑

llm-foundations

Zero-Shot vs Few-Shot Prompting: How LLMs Learn From Almost Nothing

April 9, 2026 3 minute read

Written by - Millan Kaul

LLM Fine-tuning: Customize Powerful Models for Your Needs

April 8, 2026 3 minute read

Written by - Millan Kaul

LLM Pre-training: Learning From Trillions of Words

April 7, 2026 2 minute read

Written by - Millan Kaul

Transformer Architecture: The Engine Behind Every LLM

April 6, 2026 2 minute read

Written by - Millan Kaul

Attention Mechanism: How LLMs Decide ‘What Matters Most’

April 5, 2026 3 minute read

Written by - Millan Kaul

Word Embeddings: How AI Understands ‘Similar Meaning’

April 4, 2026 3 minute read

Written by - Millan Kaul

What is Tokenization? How LLMs See Your Text

April 3, 2026 4 minute read

Written by - Millan Kaul

What is an LLM - Large Language Model ?

March 29, 2026 4 minute read

Written by - Millan Kaul

Back to top ↑

ai-tools

How to Build Your First Local RAG Pipeline with Ollama, Qdrant, and Python

August 5, 2026 1 minute read

Learn how to run your first RAG pipeline locally with Ollama, Qdrant, Python, LangChain, guardrails, and RAGAS evals.

Open Banking MCP: Compare Bank Rates in Your AI Assistant

May 1, 2026 2 minute read

Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...

Where MCP Shines

February 10, 2026 less than 1 minute read

“Single LLMs hallucinate. Multi‑agent systems multiply the problem.”

How MCP Works?

February 5, 2026 1 minute read

“MCP handshake → tool call → your code runs. 3 minutes to understand.”

Why MCP?

February 3, 2026 1 minute read

“Last week my LLM swore the 2024 World Cup winner was ‘Moon United FC’. It was confident, detailed, and 100% hallucinated.”

When to Use MCP?

January 31, 2026 1 minute read

MCP = LLM lifeline when models hallucinate most.

What is MCP?

January 24, 2026 1 minute read

Model Context Protocol (MCP) = Standardized way for LLMs to discover and call your external tools/data.

Back to top ↑

mcp

Where MCP Shines

February 10, 2026 less than 1 minute read

“Single LLMs hallucinate. Multi‑agent systems multiply the problem.”

MCP: 5 Leadership Lessons

February 7, 2026 1 minute read

From hype to control. Here are the 5 truths every CTO must know.

How MCP Works?

February 5, 2026 1 minute read

“MCP handshake → tool call → your code runs. 3 minutes to understand.”

Why MCP?

February 3, 2026 1 minute read

“Last week my LLM swore the 2024 World Cup winner was ‘Moon United FC’. It was confident, detailed, and 100% hallucinated.”

When to Use MCP?

January 31, 2026 1 minute read

MCP = LLM lifeline when models hallucinate most.

What is MCP?

January 24, 2026 1 minute read

Model Context Protocol (MCP) = Standardized way for LLMs to discover and call your external tools/data.

Back to top ↑

quality-engineering

Machine Learning Pipelines: The Backbone of Reliable AI Systems

May 17, 2026 3 minute read

An ML pipeline turns raw data into deployable models through repeatable, automated steps that improve consistency, scale, and reliability.

Why AI Agents Need a Test Harness

May 14, 2026 4 minute read

AI agents do not become reliable because the model is bigger. They become reliable because the harness around the model is testable, observable, and continuo...

constitution.md in Spec-Driven Development

May 13, 2026 3 minute read

Here is what constitution.md is, and how developers, architects, and QA teams should use it in spec-driven development.

Spec-Driven Development: QA’s North Star in AI-Native Teams

May 12, 2026 1 minute read

QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.

QA Toolbox: Powering Reliable AI Outputs

May 11, 2026 2 minute read

QA is not disappearing in the AI era. It is becoming the layer that makes AI outputs reliable, testable, and safe.

Back to top ↑

tutorial

API testing with nightwatch in 15 mins

July 3, 2023 2 minute read

Written by - Millan Kaul

Run your first RESTful API service using docker

June 25, 2023 3 minute read

Written by - Millan Kaul

Running a local server and API testing in less than 10 minutes

September 20, 2021 4 minute read

Written by - Millan Kaul

Back to top ↑

Leadership

QE Leadership at 3 stage of org, your blueprint for QE Success

February 16, 2025 5 minute read

The most successful QE leaders don’t just enforce quality—they cultivate that environment…

How to Successfully collaborate with multiple Test Leads in a Large-Scale Projects

January 1, 2025 1 minute read

Master the art of collaborating with multiple QA leads in enterprise projects. Learn effective strategies for test coordination, risk management and successf...

Back to top ↑

tools

Say hello to Multiple : New Performance testing tool

April 6, 2024 4 minute read

Written by - Millan Kaul

Back to top ↑

coding

How MCP Works?

February 5, 2026 1 minute read

“MCP handshake → tool call → your code runs. 3 minutes to understand.”

Back to top ↑

leadership

MCP: 5 Leadership Lessons

February 7, 2026 1 minute read

From hype to control. Here are the 5 truths every CTO must know.

Back to top ↑

ai-strategy

MCP: 5 Leadership Lessons

February 7, 2026 1 minute read

From hype to control. Here are the 5 truths every CTO must know.

Back to top ↑

agents

Where MCP Shines

February 10, 2026 less than 1 minute read

“Single LLMs hallucinate. Multi‑agent systems multiply the problem.”

Back to top ↑

llm-advanced

LLM Hallucinations: Why Models Invent Facts Confidently

April 10, 2026 2 minute read

Written by - Millan Kaul

Back to top ↑

fintech

Open Banking MCP: Compare Bank Rates in Your AI Assistant

May 1, 2026 2 minute read

Ask your AI to compare home loan rates, savings accounts, and credit cards instantly. Open Banking MCP brings Australian CDR data into Claude, Cursor, and VS...

Back to top ↑