feat: Memories/Personalization by shatfield4 · Pull Request #5269 · Mintplex-Labs/anything-llm

shatfield4 · 2026-03-26T01:18:52Z

Pull Request Type

✨ feat (New feature)
🐛 fix (Bug fix)
♻️ refactor (Code refactoring without changing behavior)
💄 style (UI style changes)
🔨 chore (Build, CI, maintenance)
📝 docs (Documentation updates)

Relevant Issues

resolves #5276

Translations PR: #5277

Description

Added a new memories database table with Prisma schema and migration for storing user memories scoped to global or per-workspace
Added a Memory server model with full CRUD, promote-to-global, replace workspace memories, and multi-user migration support
Added memoryProcessed flag to workspace_chats table to track which chats have been processed for memory extraction
Added server API endpoints for memories (list, create, update, delete, promote to global, clear all, run extraction)
Added a memoryEnabled middleware guard on all memory endpoints so they 403 when the feature is off
Added ownership checks on memory update/delete/promote so users can only modify their own memories
Added a background worker job (extract-memories) that runs every 15 minutes, uses the workspace LLM to extract memories from unprocessed chats
Background extraction skips running if the user has been active in the last 20 minutes to avoid processing mid-conversation
Added memory injection into chat system prompts (streaming, sync, and API chat handlers) via a shared promptWithMemories util
Memories are reranked against the current prompt + recent history using the native embedding reranker when more than 5 workspace memories exist
Added global memory limit of 5 and workspace memory limit of 20, enforced on create and promote
Added admin Personalization settings page with toggle to enable/disable the feature, run extraction manually, clear all memories, and manage global memories
Added workspace-level Personalization settings tab where users can view, add, edit, delete, and promote workspace memories to global
Added Personalization link to the admin settings sidebar
Added Personalization tab to workspace settings, visible only when the feature is enabled
Default role users can now access workspace settings (only the Personalization tab) when memory is enabled, with proper redirects for all other tabs
Added frontend Memory API model for all memory endpoints
Added shared MemoryForm and MemoryItem components used across both admin and workspace personalization pages
Added memory_enabled to system settings supported/public fields and exposed MemoryEnabled in the system keys response
Added single-user to multi-user migration for both memories and workspace chats (assigns orphaned records to the admin user)

Visuals (if applicable)

Additional Information

Test CRUD for all areas where we can add/promote to global memories
Throughly test RBAC ensuring memories are paired to user accounts in multi-user mode
Ensure pending memories are migrated to the new admin account created when enabling multi-user mode and there are no orphaned memories

Developer Validations

I ran yarn lint from the root of the repo & committed changes
Relevant documentation has been updated (if applicable)
I have tested my code functionality
Docker build succeeds locally

…tting

… instead of ternary for readability

…eat/memory

angelplusultra

Mostly nits and refactor suggestions

…nv vars

shatfield4 · 2026-04-13T18:19:23Z

Docs PR: Mintplex-Labs/anythingllm-docs#235

angelplusultra

Some refactor suggestions and nits

angelplusultra

Note about agent chat path missing memory reranking

…t() keys

angelplusultra

LGTM. Just delete that stale comment.

regen migration so it is latest file

timothycarambat · 2026-04-23T02:24:22Z

If the workspace name is long it overflows the sidebar and is side scrollable, it should truncate to some specific length to prevent this.

timothycarambat · 2026-04-23T02:25:37Z

This can be wider as to not breakline

timothycarambat

Reminder!

This needs a documentation PR to inform users how this works, what it does, how to manage memories - basically a short tutorial on our features so that they can be informed about this new feature to take advantage of!

Notes:

When clicking edit on a memory the cursor goes to the start of the input and either should go to the end
If i have 5/5 Global memories and I have the global tab focused in sidebar and I click to add another the modal closes like it was successful but nothing happens.
the system settings check value for memories needs to be moved from "on"|"off" to "true"|"false" and reading the value should work like other fields. I know that value is a string column so it is storing that as a string but just make a helper in SystemSettings for this like the other boolean/string fields to compensate for it like - https://github.com/Mintplex-Labs/anything-llm/blob/feat/memory/server/models/systemSettings.js#L624-L632 so everything is normalized across all system settings.
See line level comments for more

Look above for QA misses in the UI i noticed

Things I did:

Refactored how Chat menu was broken up
Refactored the sidebar to prevent prop drilling and cleanup DOM and nested component rendering waterfalls

timothycarambat · 2026-04-23T02:46:57Z

+      });
+  },
+
+  demoteToWorkspace: async function (memoryId, workspaceId) {


JSDoc all these so we have type hints in UI

timothycarambat · 2026-04-23T02:47:24Z

+    })
+      .then((res) => res.json())
+      .catch((e) => {
+        console.error(e);


We dont need these error logs since we return error anyway

timothycarambat · 2026-04-23T02:48:22Z

            "@/pages/WorkspaceSettings"
          );
-          return { element: <ManagerRoute Component={WorkspaceSettings} /> };
+          return { element: <PrivateRoute Component={WorkspaceSettings} /> };


Why did we change scope of this route?

timothycarambat · 2026-04-23T02:55:10Z

+async function memoryEnabled(_req, response, next) {
+  const enabled =
+    (await SystemSettings.getValueOrFallback(
+      { label: "memory_enabled" },
+      "off"
+    )) === "on";
+  if (!enabled)
+    return response.status(403).json({ error: "Personalization is disabled." });
+  next();
+}


Rename this memoryFeatureEnabled and once you migrate the check for this to a method in SystemSettings like I mentioned in parent review comment you can then just call await SystemSettings.memoriesEnabled() and throw if not.

timothycarambat · 2026-04-23T02:56:47Z

+function ownerMatch(memory, user) {
+  const memUserId = memory.userId ?? null;
+  const reqUserId = user?.id ?? null;
+  return memUserId === reqUserId;
+}


This should also just be a middleware - it should just be skipped if the system is not in MuM.

Easy to check since the first middleware is validatedRequest which assigns
response.locals.multiUserMode = multiUserMode;

timothycarambat · 2026-04-23T03:20:30Z

+CREATE TABLE "new_workspace_chats" (
+    "id" INTEGER NOT NULL PRIMARY KEY AUTOINCREMENT,
+    "workspaceId" INTEGER NOT NULL,
+    "prompt" TEXT NOT NULL,
+    "response" TEXT NOT NULL,
+    "include" BOOLEAN NOT NULL DEFAULT true,
+    "user_id" INTEGER,
+    "thread_id" INTEGER,
+    "api_session_id" TEXT,
+    "createdAt" DATETIME NOT NULL DEFAULT CURRENT_TIMESTAMP,
+    "lastUpdatedAt" DATETIME NOT NULL DEFAULT CURRENT_TIMESTAMP,
+    "feedbackScore" BOOLEAN,
+    "memory_processed" BOOLEAN NOT NULL DEFAULT false,
+    CONSTRAINT "workspace_chats_user_id_fkey" FOREIGN KEY ("user_id") REFERENCES "users" ("id") ON DELETE CASCADE ON UPDATE CASCADE
+);
+INSERT INTO "new_workspace_chats" ("api_session_id", "createdAt", "feedbackScore", "id", "include", "lastUpdatedAt", "prompt", "response", "thread_id", "user_id", "workspaceId") SELECT "api_session_id", "createdAt", "feedbackScore", "id", "include", "lastUpdatedAt", "prompt", "response", "thread_id", "user_id", "workspaceId" FROM "workspace_chats";
+DROP TABLE "workspace_chats";
+ALTER TABLE "new_workspace_chats" RENAME TO "workspace_chats";


I know this works but i REALLY do not ever want to trust SQLite to do a full drop-and-replace of the most important table in the entire DB - you can avoid this but not adding a default field to memory_processed

timothycarambat · 2026-04-23T03:21:35Z

+  workspaceId    Int?        @map("workspace_id")
+  scope          String      @default("workspace")
+  content        String
+  sourceThreadId Int?        @map("source_thread_id")


I looked over the code and done see really any place this field even is used in a way that matters? Where is this coming from and/or how is it used?

timothycarambat · 2026-04-23T03:22:39Z

    const basePrompt = await Provider.systemPrompt({
      provider,
      workspace,
      user,
    });


Can we not just augment the prompt directly with memories in this method since we already have the user and workspace potentially in there as well?

timothycarambat · 2026-04-23T03:23:24Z

  // Compress & Assemble message to ensure prompt passes token limit with room for response
  // and build system messages based on inputs and history.
+  const systemPrompt = await promptWithMemories({
+    systemPrompt: await chatPrompt(workspace, user),


Same here - can we augment the chat in this already async method?

timothycarambat · 2026-04-23T03:24:25Z

+const { Memory } = require("../../models/memory");
+const { SystemSettings } = require("../../models/systemSettings");
+
+const INJECTED_WORKSPACE_LIMIT = 5;


This needs a description - I did not realize what it did for a while

shatfield4 added 3 commits March 25, 2026 17:21

add memory storage layer with model, endpoints, schema, and system se…

039df69

…tting

add memory extraction background worker

77f5e29

handle single-user and multi-user mode for memory extraction

dc0ca66

shatfield4 self-assigned this Mar 26, 2026

shatfield4 added 11 commits March 26, 2026 16:16

add memory injection and personalization ui

c758100

lint

2bdd852

personalization UI polish, fix RBAC for all roles, and endpoint guards

4dcff15

split admin personalization page into subcomponents

4c7c917

split admin personalization page into subcomponents, use early return…

dea632c

… instead of ternary for readability

make error responses consistent in memory endpoints

b7c096a

consolidate duplicate MemoryItem into shared component

efd6e6e

skip memory reranking when no query context is available

4e66a40

extract promptWithMemories util to deduplicate memory injection

56ec0ff

add english translations

bb900b8

Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into f…

6affb79

…eat/memory

shatfield4 changed the title ~~feat: memories~~ feat: Memories/Personalization Mar 27, 2026

shatfield4 mentioned this pull request Mar 27, 2026

Feat/memory translations #5277

Open

10 tasks

shatfield4 requested a review from angelplusultra March 27, 2026 02:09

shatfield4 assigned angelplusultra and unassigned shatfield4 Mar 27, 2026

shatfield4 marked this pull request as ready for review March 27, 2026 02:10

angelplusultra requested changes Mar 30, 2026

View reviewed changes

angelplusultra assigned shatfield4 and unassigned angelplusultra Mar 30, 2026

shatfield4 added 6 commits March 30, 2026 17:49

refactor memory api routes to eliminate ambiguous path params

9bc5b68

make memory extraction interval and idle threshold configurable via e…

a5c6297

…nv vars

add hint to memory form input

fd9c65c

inline personalization content in admin settings page

89eff2a

consolidate unprocessed chat queries into single fetch

82a9144

Merge branch 'master' into feat/memory

bd4d391

shatfield4 mentioned this pull request Apr 13, 2026

Add memories documentation Mintplex-Labs/anythingllm-docs#235

Open

8 tasks

angelplusultra requested changes Apr 13, 2026

View reviewed changes

angelplusultra assigned shatfield4 and unassigned angelplusultra Apr 13, 2026

angelplusultra requested changes Apr 13, 2026

View reviewed changes

Comment thread server/utils/agents/defaults.js

shatfield4 added 6 commits April 13, 2026 15:32

add workspace access checks to all memory endpoints

6987c3d

pass user prompt to agent getDefinition for memory reranking

7baad01

check idle threshold per user/workspace group instead of globally

6d36891

use factory pattern for i18n text sizes and replace Trans with plain …

7dbfe7e

…t() keys

add placeholder examples and format guidance for manual memory creation

c685b18

Merge branch 'master' into feat/memory

489be36

shatfield4 requested a review from angelplusultra April 13, 2026 23:26

shatfield4 assigned angelplusultra and unassigned shatfield4 Apr 13, 2026

angelplusultra approved these changes Apr 14, 2026

View reviewed changes

Comment thread server/utils/memories/index.js Outdated

Comment thread frontend/src/components/WorkspaceChat/ChatContainer/ChatSettingsMenu/index.jsx Outdated

Comment thread server/jobs/extract-memories.js

angelplusultra assigned shatfield4 and unassigned angelplusultra Apr 14, 2026

remove stale comment

4fb3af9

shatfield4 assigned timothycarambat and unassigned shatfield4 Apr 14, 2026

timothycarambat added 2 commits April 22, 2026 17:59

rebase 1.12.1

81fbe49

regen migration so it is latest file

refactor chat menu

e5a9da5

refactor sidebar to use provider and simplified DOM rendering

bd0554b

timothycarambat requested changes Apr 23, 2026

View reviewed changes

timothycarambat added the PR: Yankee label Apr 23, 2026

timothycarambat assigned shatfield4 and unassigned timothycarambat Apr 23, 2026

Uh oh!

Conversation

shatfield4 commented Mar 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Pull Request Type

Relevant Issues

Description

Visuals (if applicable)

Additional Information

Developer Validations

Uh oh!

angelplusultra left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

shatfield4 commented Apr 13, 2026

Uh oh!

angelplusultra left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

angelplusultra left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

angelplusultra left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

timothycarambat commented Apr 23, 2026

Uh oh!

timothycarambat commented Apr 23, 2026

Uh oh!

timothycarambat left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Reminder!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

shatfield4 commented Mar 26, 2026 •

edited

Loading

timothycarambat left a comment •

edited

Loading