Dynamic Filters Deep-Dive

Standard RAG search performs only question → vector similarity search. Dynamic filters first narrow scope by metadata then perform vector search, improving accuracy.

Example

Question: “Show me revenue trends from the Finance team’s 2024 reports”

Method	Behavior	Result
Without filter	Vector similarity over all documents	Other teams’ docs may be mixed in
With filter	Narrow first by `department=Finance, year=2024`, then vector search	Only relevant docs retrieved

How to Configure Filters

Define filter fields

On the Knowledge Base edit screen, click “Filter Settings” > ”+ Add Filter” to define a filter field.

Item	Description	Example
Field Name	Filter field name	”Department”, “Year”
Type	Data type	Single Select, Multi Select, Glossary, Date, Number
Mark as required	Warns files that leave this field empty when it’s set as required	Required ON/OFF toggle
Filter Options	List of allowed values (Enum/Collection types)	“Finance, HR, Engineering”
Agent Description	Description so the AI understands the filter	”Filter by the document’s department”
Extraction hint	Instruction used for AI auto-extraction	”Extract the department name from the filename”

Choose extraction mode

Toggle Manual / AI at the top of the filter schema.

	Manual mode	AI mode
Input method	User enters per file	LLM auto-extracts from file content
Accuracy	100% (human-entered)	Depends on LLM performance
Time	Proportional to file count	One-click bulk extraction
Cost	None	LLM call cost
Recommended for	Few files or accuracy-critical	Many files needing fast classification

AI-mode results can be edited manually. The most efficient flow is bulk-extract with AI first, then fix only the errors.

Save

Click Save to save the filter schema. In AI mode, metadata is auto-extracted on subsequent file uploads.

Filter Type Details

Type	Search Behavior	Use Cases
Single Select	Exact match	Department, category, status
Multi Select	Match any one of multiple values	Tags, related teams
Glossary	Look up and search in a glossary	Product name
Date	Range search	Created date, expiry date
Number	Exact match	Year, version

Date Filter Input Format

Date filters accept varying precision:

Input	Meaning	Search Range
`2024`	All of 2024	2024-01-01 ~ 2024-12-31
`2024-03`	March 2024	2024-03-01 ~ 2024-03-31
`2024-03-15`	Specific date	That day only

Metadata State Display

In the file list, each file’s metadata state is shown as a color dot.

Color	State	Meaning
🟢 Green	Complete	All filter fields have values
🔵 Blue	Partial	Only some fields are set
🟠 Orange	Missing Required	Required field is empty
⚪ Gray border	Empty	No metadata set
🟣 Purple spinner	Extracting	AI extraction in progress

Files in Orange (Missing Required) state may be omitted from filter searches. Make sure to fill in required fields.

AI Auto-Extraction

Writing Extraction Hints

The extraction hint is the instruction the AI uses when extracting metadata values from file content. Examples of good extraction hints:

Filter	Extraction hint
Department	”Extract the department from document content or filename. Options: Finance, HR, Engineering”
Year	”Extract the publication year from the document. If the filename contains a year, use it”
Document type	”Determine the document type. Options: policy, guide, report, form”

The AI analyzes the first ~4,000 characters of the file. The closer key information is to the beginning, the better extraction accuracy.

Running Extraction

Method	Description	When to Use
Auto-extraction	Runs automatically on upload	When AI mode is active and a new file is added
Single-file extraction	File metadata edit > Extract button	Re-extract a specific file
Bulk extraction	Bulk extract button at the top of the KB	Re-apply across all files after schema change

How Agents Use Filters

When you connect a KB with dynamic filters to an agent, auto-filtering happens through this flow.

Step Details

Inform the AI about filters

On agent start, the system reads the KB’s filter schema and auto-adds filter hints to the agent description.For example, with a “Department” filter, the AI knows “I can filter this KB by department”.

Extract filter values from the question

When a user asks a question, the AI auto-extracts filter values from the content.

Question: "Show me revenue trends from the Finance team's 2024 reports"

AI extraction:
  department → "Finance" (high confidence)
  year → 2024 (high confidence)

The AI only applies filters with high confidence. If filter values can’t be determined from the question, it falls back to standard vector search without filters.

Build the search filter

Extracted filter values are internally converted to a filter query the search engine understands.

User input: department=Finance, year=2024
     ↓
Internal: f_str_1='Finance' AND f_int_1=2024
     ↓
Passed to the search engine query

Run filtered search

The search engine performs vector similarity search only on documents matching the filter conditions. Documents from other teams or years are excluded from search.

Generate the answer

Filtered relevant documents are passed to the AI to generate an accurate answer.

Agent Description and Filters

The agent description is the key signal that helps the AI agent decide when to use a Knowledge Base, and which filter to apply.

	Without Agent Description	With Agent Description
KB selection	Decided by KB general description (may be inaccurate)	Clear purpose guidance for accurate selection
Filter usage	May not know filters exist	Knows which filter to use in which situation

AI auto-generation recommended: Click the auto-generate button next to the agent description field — the AI drafts the agent description based on the KB name + description + file list + filter info.

After changing the filter schema, regenerate the agent description. New filter info must be reflected in the agent description for the AI to use filters accurately.

Caveats

Are files with empty required fields omitted from search?

Yes. Files without values in fields marked Required are not included in results when searching with that filter condition. Look for orange dots and fill in values.

Can AI extraction be wrong?

AI extraction analyzes about the first 4,000 characters of the document — if key information is in later sections, extraction can be inaccurate. Review results and edit manually as needed.

What happens to existing metadata when I change the filter schema?

Adding a filter field leaves existing files’ values empty. Run bulk extraction in AI mode to populate the new field. Removing a field also removes that metadata.

Rather than adding too many filters to one Knowledge Base, consider splitting into separate Knowledge Bases if you need finer classification.

Workspace

AI Agents

Knowledge & Data

Safety

Customization

Example

How to Configure Filters

Define filter fields

Choose extraction mode

Save

Filter Type Details

Date Filter Input Format

Metadata State Display

AI Auto-Extraction

Writing Extraction Hints

Running Extraction

How Agents Use Filters

Step Details

Inform the AI about filters

Extract filter values from the question

Build the search filter

Run filtered search

Generate the answer

Agent Description and Filters

Caveats

​Example

​How to Configure Filters

Define filter fields

Choose extraction mode

Save

​Filter Type Details

​Date Filter Input Format

​Metadata State Display

​AI Auto-Extraction

​Writing Extraction Hints

​Running Extraction

​How Agents Use Filters

​Step Details

Inform the AI about filters

Extract filter values from the question

Build the search filter

Run filtered search

Generate the answer

​Agent Description and Filters

​Caveats

Example

How to Configure Filters

Filter Type Details

Date Filter Input Format

Metadata State Display

AI Auto-Extraction

Writing Extraction Hints

Running Extraction

How Agents Use Filters

Step Details

Agent Description and Filters

Caveats