Adopt

AI Agents for Help Desks: Building Internal Q&A and Inquiry Handling

・ Employee Store Operations

Summary

Internal help desks and customer inquiries are work an AI agent handles well. But without source documents to draw answers from, the AI returns plausible-sounding mistakes. This article covers how to prepare documents, where to hand off to people, how to build with n8n and Dify, and how to monitor quality.

The tool features in this article were checked against each vendor's official documentation on October 2, 2026. Features and screens may change. Before you rely on them, check the latest information through the sources at the end.

When you automate a help desk with an AI agent, do not aim to have it answer every question. Have it answer only questions whose answers are in the documents, and route everything else to people. The same approach applies to internal Q&A and customer inquiries.

Inquiries That Are Easy to Delegate

Easy to delegate are inquiries whose answers are written in documents and are the same no matter who asks. Internally, examples include how to file expenses, where to submit leave requests, and steps to reset a password. For customers, examples include how to use a product, differences between pricing plans, and procedural steps.

Hard to delegate are inquiries whose answers depend on the person's situation. Contract changes, refund decisions, complaints, and consultations about personal evaluations or health go to people without the AI drafting an answer. The AI's role ends at receiving the inquiry, organizing its content, and passing it to the person in charge.

When you start internal Q&A with an AI agent, look at past inquiries and prepare documents for the most common questions first. You do not need to cover every question from the start. If you show users what is in scope, out-of-scope questions reach people from the beginning.

Routing inquiries

May the AI answer this inquiry?

The answer is in the documentsThe AI answersShow the documents referenced
The documents have no answerRoute to a personDo not let it invent an answer
It involves contracts, refunds, complaints or personal circumstancesRoute to a personOrganize the content and hand it over

Prepare the Source Documents

The quality of an AI agent's answers is set by the quality of the documents you give it. The approach of searching documents for relevant passages and building an answer from them is called RAG (retrieval-augmented generation). We explain the differences in AI Agents vs. RAG.

  • Delete old versions. If both old and new procedures exist, the AI may answer with the old one
  • Cover one topic per document. When topics are mixed, the AI pulls in unrelated passages
  • Put the question's wording in headings. Write the way employees and customers actually ask
  • For procedures shown only in tables or images, also write them out in text
  • Assign an owner and an update date to each document

In Dify, you register documents in a feature called Knowledge. It supports uploading local files, syncing from Notion, and importing from websites. After registering, you can use the retrieval test to see which passages are pulled for a given question. For details, see How to Use Dify Knowledge.

Do not register documents containing customers' personal information as-is. In its June 2, 2023 alert, Japan's Personal Information Protection Commission (PPC) asks businesses entering personal information into generative AI services to confirm that it is within the purpose of use and, for example, that the provider does not use the data for machine learning.

Design the Handoff for Questions It Cannot Answer

Design the handoff to people first. If you add it later, gaps where the AI invents answers tend to remain. Decide three things: when to hand off, where to hand off, and what to pass along.

  1. When to hand off: no answer is found in the documents, the question falls in a category you do not delegate, or the user writes that they want to talk to a person
  2. Where to hand off: the responsible channel in your team chat, your inquiry management tool, or the owner's email
  3. What to pass along: the full question, the documents the AI searched, and the user's contact details (only if the user provided them)

The n8n official documentation has an example workflow that sends a message to Slack asking a person for help when the AI cannot answer. In this example, it asks the user for an email address before notifying staff. In Dify, the Question Classifier node sorts inquiries and routes each category to a different process. For example, product usage questions are answered from documents, while return requests are routed to a staff contact.

Tell users that their inquiry was passed to a person and roughly when they will get a reply. If you hide that the AI could not answer, users send the same question again and again.

How to Build It with n8n and Dify

You can build a help desk chatbot with either n8n or Dify. These are the main components confirmed in the official documentation.

Main components for building a chatbot (checked October 2026)
Rolen8nDify
Chat entry pointChat Trigger node, using n8n's chat interface or embedded in your own interfaceChatbot or Chatflow app, published as a web app, via API, or embedded
Finding documentsVector store nodes such as Pinecone, Qdrant, and PGVectorKnowledge and the Knowledge Retrieval node
Classification and branchingAI Agent node combined with toolsQuestion Classifier node
Human reviewApproval before tool use (arrives in Slack and other channels)Human Input node (sends a form via web app or email)

Building a Chatbot in n8n

To build a chatbot in n8n, use the Chat Trigger node as the entry point and connect it to a node such as AI Agent. The Chat Trigger must be connected to an agent or chain node. For the interface, you can use the chat interface n8n provides or embed it in your own interface. To embed it, use n8n's chat widget or build your own interface.

The Chat Trigger can be set to public access, basic authentication with a shared username and password, or access only for people logged in to n8n. For internal Q&A, do not make it public. Also, each message sent to the Chat Trigger runs the workflow once. If 10 messages are sent in one conversation, that is 10 executions. n8n pricing is based on the number of executions, so estimate from the number of users and the number of exchanges per user.

Counting executions for n8n chat
1 runExecutions per 1 message10 messagesMessages sent in 1 conversation10 runsExecutions used by that conversation

Building a Chatbot in Dify

Dify describes its Chatbot as the simplest way to build a conversational app with a model and a prompt. If you only need answers drawn from documents, you can start by connecting Knowledge to a Chatbot. If you want to classify inquiries and split the processing, combine the Question Classifier node and the Knowledge Retrieval node in a Chatflow. Apps you build can be published as a web app, via API, or embedded in a website.

How to Keep Monitoring Answer Quality

Keep monitoring answer quality after launch. Watch three things: user ratings, questions it could not answer, and wrong answers.

Keeping answer quality up
  1. 1Review the logsCollect low ratings and unanswered questions
  2. 2Sort out the causeMissing documents, outdated documents, or poor retrieval
  3. 3Fix documents or annotationsRecord the date and who fixed it
  4. 4Run test questionsCheck everything after the fix

Decide how often to review and who owns it before launch. Without an owner, nobody fixes the documents when low ratings come in, and the same mistakes continue. Treat unanswered questions as a record that shows you where documents need to be added.

Dify's logs let you see what users asked, how the app answered, and what rating it received. User likes and dislikes, along with comments, are stored with the message they refer to. A feature called Annotations lets you register human-written answers for specific questions. When a similar question comes in, Dify returns the registered answer instead of generating a new one. You can also correct an answer in the logs and save it as an annotation, and see how many times each annotation has been used.

n8n has a feature called Evaluations. You prepare pairs of test questions and expected answers, run them through the workflow, and compare the results. The documentation describes two uses: before launch, a light evaluation where you compare a small number of examples by eye; after launch, a metric-based evaluation with more examples drawn from real conversations. When you find a mistake, add that question to the test set and rerun the whole set after the fix. We explain how to think about evaluation in How to Evaluate AI Agents.

The Customer Support Category on Employee Store

Employee Store is a marketplace where companies can adopt AI agents built by developers. One of its categories is customer support. Sellers can list in any format, including n8n or Dify workflows and their own custom-built agents.

Pricing is one-time purchase, monthly, or setup fee plus monthly, and payment is through Stripe. After purchase, you message the seller in the deal room, check the deliverables, and accept them. Delivery is, in principle, within 3 business days, and you are refunded if it runs late. Before you adopt an agent, check on the listing page which documents you need to prepare and whether it has a way to hand off to people.

FAQ

Will an AI agent chatbot answer questions that are not in the documents?
Unless you configure it otherwise, it may generate a plausible-sounding answer. Design it from the start so that when no answer is found in the documents, it does not invent one and hands off to a person.
Should I build my help desk with n8n or Dify?
Either works. Dify has Knowledge, the Question Classifier, Annotations, and logs built into the app. n8n makes it easier to build processes that connect to other services such as Slack and inquiry management tools. Also factor in that n8n's Chat Trigger uses one execution per message.
How do I reduce wrong answers?
Regularly review user ratings and unanswered questions, and fix the documents. For questions that should always get a set answer, register a human-written answer as a Dify annotation. In n8n, the Evaluations feature lets you run test questions and compare the results.

About the author

Employee Store OperationsThe operations team behind Employee Store, a marketplace for AI agents. We check tool features and pricing against official sources and list them at the end of each article. If you spot an error, please let us know via the contact form.

Sources

Ask AI

Ask AI if it fits your work.

Use your usual AI to explore what Employee Store offers and what to check before buying.

Opens an external AI service. Confirm pricing and deliverables on the listing page.