Skip to content
Koltrix

Pulling action items out of an email thread with AI, and checking them

AI can list who owes what after a long thread, but it also invents tasks and misses hidden ones. A reliable prompt, a checking routine and what to keep human.

Koltrix Team5 min read
Colorful sticky notes pinned to a board
Photo by Patrick Perkins on Unsplash
On this page(9 sections)
  1. What counts as an action item
  2. Why AI gets it wrong
  3. A prompt that is easier to check
  4. A thirty-second check
  5. Measure it instead of trusting a feeling
  6. Where to keep humans in charge
  7. Turning the list into something useful
  8. Privacy note
  9. Key takeaways

A thread with twenty messages and six people ends with a vague "sounds good, let's move on this". Now someone has to work out what was decided, who is doing what and by when. It is exactly the sort of chore an AI assistant seems made for: read everything, produce a tidy list of action items.

It does that well often enough to be tempting and badly often enough to be risky. A list that looks neat but contains an invented deadline, a task given to the wrong person or a missing commitment is worse than no list, because people trust it. This guide shows how to ask for action items in a way that is easier to check, how to check them quickly, and where to keep a human in charge.

What counts as an action item

Before you prompt anything, agree on what you want. In email, an action item has four parts:

  • A task. Something someone will do, in a verb phrase: "send the revised quote".
  • An owner. The person who said they would do it, or who was clearly asked and agreed.
  • A due date or trigger. "By Friday", "after the contract is signed", or none stated.
  • A source. The message where it was said, so you can verify it.

Three kinds of statements look like action items and are not:

  • Suggestions without agreement. "We could try a new layout" is an idea, not a commitment.
  • Questions waiting for an answer. "Can you check the invoice?" becomes an action item only once the person accepts, or if the relationship makes the request binding. Treat it as an open question until then.
  • History. "I sent the file yesterday" is a finished action, not a to-do.

Models blur these lines unless told otherwise. Spell the definitions out in the prompt.

Why AI gets it wrong

Knowing the usual failures tells you what to check.

  • Invented owners. A message addressed to the group, such as "someone should follow up", gets assigned to a specific person.
  • Invented dates. "Soon" becomes a date, or "next week" is converted using the wrong reference day, a problem with every relative date. See AI summaries of long threads for how models handle long context.
  • Missed items in quoted text. In long threads, earlier messages are quoted inside later ones. Models can read a commitment twice, or miss one buried in a quote.
  • Late reversals. An item agreed in message 5 and cancelled in message 14 can still appear on the list.
  • Mixed-up pronouns and names. "I'll do it" attributed to whoever was mentioned last.
  • Implied tasks. The model adds the obvious next step that nobody mentioned. It reads as helpful and is a guess.

Catching hallucinations in AI-drafted replies covers the same family of errors for drafts.

A prompt that is easier to check

The aim is to make every item traceable and every uncertainty visible. You can adapt the structure below to any assistant.

Read the email thread below. List the action items that people have
explicitly agreed to or been explicitly assigned.

Rules:
- Include an item only if someone commits to it ("I'll...", "we will...")
  or is directly asked and does not decline. Do not suggest new tasks.
- For each item give: task, owner (name as written), due date exactly as
  stated, and a short quote with the sender and the message date.
- If the owner or date is not stated, write "not stated". Never guess.
- Convert relative dates only if I give you today's date: {today}.
  Otherwise keep the original wording.
- If an item was later cancelled or changed, list the final version and
  note the change.
- Separately list open questions that nobody has answered.
- If there are no action items, say so.

Thread:
{thread}

Four things make this work. It forbids new tasks. It demands a quote, which turns every item into something you can verify in seconds. It names "not stated" as an acceptable answer, which reduces guessing. And it keeps open questions separate from commitments.

A thirty-second check

Do this before you act on any list.

  1. Spot-check every quote. Find the quoted line in the thread. If it is not there, discard the item.
  2. Read the owner column. Does each owner match the person who actually spoke? Pay attention to group messages.
  3. Compare dates to the text. If the model gave a date where the thread says "soon", it has guessed.
  4. Look for reversals. Search the thread for "actually", "scratch that", "cancel" and "instead".
  5. Scan the last three messages for anything the list ignores.
  6. Ask what is missing. Skim the thread once for promises you expected to see and did not.

For a high-stakes thread, such as a contract, a customer complaint or a deadline with money attached, read it yourself and use the AI list as a second opinion, not the first.

Measure it instead of trusting a feeling

If you rely on this regularly, test it. Take 20 real threads (with confidential details removed or permission given), write the correct list by hand, and compare it with what the assistant produces. Count three things: items it missed, items it invented and items with a wrong owner or date. A small fixed set like this, described in a golden set for AI drafts, lets you try a new prompt or model and see whether it is better or only different.

Where to keep humans in charge

  • Commitments to customers. A person should confirm every promise before it enters a tracker or a reply.
  • Anything with money, legal weight or a deadline that is hard to move.
  • Assigning work to other people. The AI reports who said what. A human decides who is accountable.
  • Sending. An assistant can draft a message that confirms the list ("Here is what I understood: ..."), and the person reads and sends it. A confirmation message is a good check on its own, because the other side corrects mistakes.

Turning the list into something useful

A list in a chat window disappears. Put the confirmed items where work happens:

  • A shared task list or tracker, with a link to the thread.
  • A reminder before each due date.
  • A short summary back to the thread, stating who does what by when. This protects against the "I thought you were doing that" problem described in why two people answer the same email.

Tools that track promises across threads, such as Promise Keeper, do part of this for you, and an assistant connected through the Koltrix MCP server can read a thread and answer questions about it from the apps you already use. The same rules apply to all of them: quote the source, say what is unknown and check before you rely on it.

Privacy note

Pasting a thread into an AI tool sends its contents to that provider. For confidential mail, check your policy first. Keeping confidential email out of AI and what your AI provider sees when you query your inbox explain what to look at.

Key takeaways

  • An action item is a task with an owner, a due date or trigger and a source. Suggestions, open questions and finished work are not action items.
  • Models invent owners and dates, miss items inside quoted text and keep cancelled tasks, so tell them not to guess.
  • Ask for a quote and message date for every item, and let "not stated" be a valid answer.
  • Check quotes, owners, dates and late reversals before you act, and read high-stakes threads yourself.
  • Keep people responsible for commitments, assignments and sending, and move confirmed items into a tracker with reminders.

Start with Koltrix

Your domain, one inbox, and an API that sends.

A team inbox where AI sorts and drafts (nothing is sent without your click), plus the transactional API and SMTP relay your product sends with. 7 days free, no card.

SharePost on XLinkedIn