mirror of
https://github.com/Wx-2025/ST-Amily2-Chat-Optimisation.git
synced 2026-06-14 10:55:50 +00:00
### 新功能
- **翰林院向量化质量升级**:
- **边界感知切块**:替换四个来源(聊天记录/小说/世界书/手动)的纯字符硬切——优先在段落边界断开,其次句末标点(含中文引号闭合),极端长串才硬切;句子/对话不再被拦腰截断,embedding 质量同步受益。仅影响新录入,已有向量无需重建
- **注入时序重排**:检索结果注入提示词前按时序重排(聊天记录按楼层、小说按卷/章/节——中文数字章节号可解析),rerank 只决定"选哪些块",不再决定呈现顺序;修复"不打不相识的剧情之后紧跟关系亲密"这类因按相关度排序导致的认知时间错乱
- **断层提示**:聊天记录相邻块楼层跳跃时自动插入"与上文相隔约 N 楼,并非连续发生"提示行,消除中间剧情缺失造成的割裂感
- **时间标识**:新录入的聊天记录块在来源标识中带上消息发送时间(ST 向量存储不持久化元数据,时间必须写入块文本才能在检索后取回;旧格式块兼容解析)
- **记忆块工作流(memory-blocks)**:剧情优化新增"自定义记忆块"体系——占位符驱动的并发工作流框架
- 在剧情优化面板「匹配替换 (sulv)」下方可增删自定义块:每个块定义一个占位符,执行剧情优化时主/拦截提示词中的占位符会被块的产出替换
- **静态块**:直接输出固定内容;**AI 调用块**:用所选 API 功能槽独立请求一次,把回复(或其中指定 `<标签>` 的内容)作为替换值
- 原有 sulv1-4 速率占位符迁入同一框架,行为与旧版逐字节一致
- 块定义为纯 JSON、随设置持久化,为后续导入导出与战斗系统接入预留扩展点
- 框架层新增**顺序拼接式 Chain**(`composeChain`):与占位符替换并列的第二种组合范式——同链的块并发执行后按 `order` 排序、以 `separator` 拼接并可选 `header/footer` 包裹,产出一个完整注入块;为记忆注入合成块与战斗系统"底部战报块"预留的承载结构,本版本暂无 UI 入口
- **渐进记忆(开发中功能,暂未对外开放)**:主菜单新增独立入口(点击提示"开发中,未来版本开放"),后续完善后放出。当前已落地的设计:
- 按"近期完整、远期摘要"的时间梯度,从指定表格(默认总结表,行序旧→新)采样历史并注入上下文:最新 X 行全量保留 + 其余历史对半拆分,较近一半等距取 Y 行、较远一半等距取 Z 行(中心对齐等距采样,不随机、不首尾加权,避免内容扎堆或事件结局被规律性忽略)
- 经 `setExtensionPrompt` 直接注入当回合上下文——内容独立、不写世界书、不随聊天/角色卡导出,生命周期天然跟随会话(区别于超级记忆的世界书条目路线)
- 注入位置 / 深度 / 角色 / 模板(含 `{{progressive_memory}}` 占位符)均可在面板配置;采样参数 X/Y/Z 默认 5/5/3,全部纯 JSON 持久化
- 采样器 `sampler.js` 为纯函数,参数结构与 memory-blocks 工作链对齐,后续可平移为 `progressive_sample` 节点
- **超级记忆 · 首行常驻**(表格专属配置新增开关,默认关闭):表格第一行通常是总调/全局定义行(基调、主线目标等),原先与普通行一样走绿灯——没人提到主键就永远不注入;开启后该行详情条目升为蓝灯常驻,切换即时生效
- **API 连接配置**:
- 角色世界书(cwb)与一键生卡(autoCharCard)纳入旧配置自动迁移:老用户首次加载会把旧 URL / Key / 模型自动迁移为连接配置并分配槽位(一键生卡仅在规划者与执行者配置一致或规划者为空时迁移,避免悄悄改变行为)
- **profile 已分配时参数控件 informational 化**:主面板 / 并发剧情优化 / 角色世界书 / 术语表的温度、maxTokens 控件在槽位分配 profile 后自动禁用并显示"由连接配置控制"提示,消除"改了没效果"的用户陷阱
- **profile 状态卡新增"本设备无 Key"警示**:API Key 仅保存在最初填写它的设备/浏览器上(安全设计,不随云端设置同步),换设备后状态卡会直接亮出警示徽标,不必等到调用报错才发现
### 修复
- **独立聊天记忆从摆设变真功能**:此前向量数据"随卡不随聊天"——开启"独立聊天记忆"后录入仍存进角色库、查询却去查一个从未被写入过的聊天集合、计数恒为 0,整体静默失效。现已重构为聊天级分桶:
- 独立模式下,聊天记录类向量按当前聊天隔离存储与检索,同一张卡开多个聊天(不同剧情线)的记忆互不污染
- 小说 / 世界书 / 手动录入属于"知识",仍随角色卡跨聊天共享;全局库不受影响
- 知识管理列表为聊天专属库显示"聊天级"徽标;聊天级库禁止移动到全局
- 统一模式(默认关闭独立记忆)的存量数据与行为完全不变
- 已知限制:聊天专属记忆跟随聊天文件,重命名聊天文件会使其失联(与 ST 官方向量扩展同等限制)
- **超级排序截断顺序修正**:开启"超级排序"时,时序重排发生在 top_n 截断之前,导致保留的是"时序最早"而非"最相关"的块,检索结果长期偏向最旧的聊天记录。现改为先按相关度截取 top_n、再做时序排序
- **翰林院向量化失败("向量化块数量不识别"反馈)**:
- 一次性清洗 profile-sync 历史污染:`retrieval/rerank.apiKey` 中的掩码占位符在持久层根治(此前仅读取侧防御);`apiEndpoint` / `rerank.apiMode` 的非法值(如被旧版写入的空字符串)归一化为 `custom`
- 修复 `apiEndpoint` 为空/非法时请求被硬定向到 `api.openai.com`、无视用户自定义 URL 的问题(CSP 拦截 / 401 的元凶)
- 修复**本地代理(LM Studio/Ollama)模式**自始就缺少 URL 分支、同样被错误定向到 openai.com 的问题
- API 模式下拉补全 `OpenAI 官方` / `Azure` 选项;默认 API 模式改为 `custom`(与默认 URL 配套),新用户不再因选项缺失导致首次保存写入空值
- profile-sync 给下拉框赋不存在选项值的污染源头修复(影响所有模块面板,不止翰林院)
- **Rerank "测试成功但实际请求报 API Key 未提供"(路径分叉根因)**:实际重排调用 `executeRerank(query, docs, settings.rerank)` 直接把 legacy 嵌套设置当连接传入,绕过了 `getRerankSettings()` 的 profile 解析;而「测试连接」传 `null` 会正常解析 profile——于是用 API Profile 配 rerank 的用户测试通过、实际生成时却拿到空 apiKey/stale url 报错。现实际调用点统一走 `getRerankSettings()`(profile 优先、legacy 兜底),与测试路径一致;`enabled / notify / hybrid_alpha` 等行为开关仍读 legacy 设置
- **Rerank "API Key 未提供"报错升级**:当原因是"连接配置在本设备没有可用 Key"时,报错会直接说明 Key 的设备本地性并指引到 API 连接配置重新填写(向量化 Google 直连、获取模型列表同步处理)
- **旧配置迁移**:一键生卡迁移时排除掩码占位符,避免把历史污染的假 Key 迁入新连接配置
- **超级记忆稳定性专项**(针对"工作不大稳定"反馈,4 处根因一次修复):
- **切聊天竞态污染**:CHAT_CHANGED 时超级记忆立即全量同步,而表格系统延迟 100ms 才加载新聊天的表格,导致【旧聊天】的表格内容被写进【新角色】的记忆世界书;两边表名不同时旧表条目无 GC 兜底会**永久残留**("记忆串台"元凶)。现 CHAT_CHANGED 只确保世界书存在,新状态同步交由 `loadTables()` 完成后的自动推送,单次且时序正确
- **死代码双轨存储拆除**:`saveStateToMetadata` / `tryRestoreStateFromMetadata` 把表格状态写到 `msg.metadata`——该字段非 ST 持久化位(同 v2.2.5 二次填表修过的坑),写入即蒸发、恢复永远为空,且每次同步还白调一次 `saveChat()`。整条链路删除,表格状态唯一信源为表格系统的 `msg.extra.amily2_tables_data`
- **`awaitSync()` 穿透**:同步队列正忙时 `pushUpdate` 会用一个立即 resolve 的空 Promise 覆盖 `_syncPromise`,Pipeline Stage 4 等待形同虚设、后续阶段在同步未完成时被放行。现忙时不覆盖,正在运行的 drain 循环自然吃掉新入队项
- **开关打开不生效**:启动时若总开关为关,初始化早退且不注册监听器;此后在 UI 勾选开关只写设置,超级记忆直到刷新页面前都是死的。现勾选即触发初始化(幂等)
- 附带:`forceSyncAll` 的表格角色推断改为复用 `events-schema.inferTableRole`,消除两处重复逻辑漂移风险;每次切聊天的双倍全量同步(restore 路径一次 + 显式一次)随死代码移除归一
### 重构
- 表格核心 `manager.js` 瘦身(约 1050 → 600 行):19 个 UI 突变操作拆分至 `actions/ui-mutations.js`,SuperMemory 事件分发拆分至 `events-dispatch.js`;全部经 re-export 保持兼容,外部调用路径零改动
- 角色世界书最后 2 处散乱的厂商 URL 判断迁移至 `detectVendor` 统一入口,业务路径上不再有硬编码的 URL substring 判断
311 lines
12 KiB
JavaScript
311 lines
12 KiB
JavaScript
import { amilyHelper } from "../tavern-helper/main.js";
|
||
import { extension_settings, getContext } from "/scripts/extensions.js";
|
||
import { extensionName } from "../../utils/settings.js";
|
||
import { this_chid, characters } from "/script.js";
|
||
import { withLoreLock } from "../lore-service.js";
|
||
|
||
export function getMemoryBookName() {
|
||
let charName = "Global";
|
||
const context = getContext();
|
||
|
||
if (this_chid !== undefined && characters[this_chid]) {
|
||
charName = characters[this_chid].name;
|
||
} else if (context.characterId !== undefined && characters[context.characterId]) {
|
||
charName = characters[context.characterId].name;
|
||
}
|
||
|
||
const safeCharName = charName.replace(/[<>:"/\\|?*]/g, '_');
|
||
return `Amily2_Memory_${safeCharName}`;
|
||
}
|
||
|
||
/** 无锁内核:在已持有写锁时调用(避免嵌套死锁) */
|
||
async function _doEnsureBook(bookName) {
|
||
const books = await amilyHelper.getLorebooks();
|
||
if (!books.includes(bookName)) {
|
||
console.log(`[Amily2-Bridge] 创建角色专用世界书: ${bookName}`);
|
||
await amilyHelper.createLorebook(bookName);
|
||
}
|
||
const settings = extension_settings[extensionName] || {};
|
||
const shouldBind = settings.superMemory_autoBind === true;
|
||
if (shouldBind && bookName.startsWith("Amily2_Memory_") && bookName !== "Amily2_Memory_Global") {
|
||
console.log(`[Amily2-Bridge] 自动绑定世界书到当前角色...`);
|
||
await amilyHelper.bindLorebookToCharacter(bookName);
|
||
} else if (!shouldBind) {
|
||
console.log(`[Amily2-Bridge] 跳过自动绑定 (设置已禁用)。请手动在世界书管理中激活: ${bookName}`);
|
||
}
|
||
}
|
||
|
||
/**
|
||
* @param {Object} [opts]
|
||
* @param {number} [opts.depth=100] 详情条目的注入深度
|
||
* @param {boolean} [opts.isIndexConstant=true] 索引条目是否常驻(蓝灯)
|
||
* @param {boolean} [opts.pinFirstRow=false] 首行详情条目升为常驻(总调/全局定义行)
|
||
*/
|
||
export async function syncToLorebook(tableName, data, indexText, role, headers, rowStatuses, opts = {}) {
|
||
const {
|
||
depth = 100,
|
||
isIndexConstant = true,
|
||
pinFirstRow = false,
|
||
} = opts;
|
||
console.log(`[Amily2-Bridge] 开始同步表格: ${tableName} (Depth: ${depth}, IndexConstant: ${isIndexConstant}, PinFirstRow: ${pinFirstRow})`);
|
||
return withLoreLock(`syncToLorebook(${tableName})`, async () => {
|
||
await _doEnsureBook(getMemoryBookName());
|
||
|
||
const bookName = getMemoryBookName();
|
||
|
||
let entries = await amilyHelper.getLorebookEntries(bookName);
|
||
if (!entries) entries = [];
|
||
|
||
const entriesToUpdate = [];
|
||
const entriesToCreate = [];
|
||
|
||
const arraysEqual = (a, b) => {
|
||
if (a === b) return true;
|
||
if (a == null || b == null) return false;
|
||
if (a.length !== b.length) return false;
|
||
const sA = [...a].sort();
|
||
const sB = [...b].sort();
|
||
return sA.every((val, index) => val === sB[index]);
|
||
};
|
||
|
||
const processEntry = (comment, keys, content, type = 'selective', enabled = true, excludeRecursion = false, specificOrder = null, specificDepth = null) => {
|
||
const existingEntry = entries.find(e => e.comment === comment);
|
||
if (existingEntry) {
|
||
let isChanged = false;
|
||
|
||
if (existingEntry.content !== content) isChanged = true;
|
||
if (!arraysEqual(existingEntry.key, keys)) isChanged = true;
|
||
if (existingEntry.enabled !== enabled) isChanged = true;
|
||
|
||
const shouldBeConstant = (type === 'constant');
|
||
if (!!existingEntry.constant !== shouldBeConstant) isChanged = true;
|
||
|
||
if (!!existingEntry.exclude_recursion !== excludeRecursion) isChanged = true;
|
||
|
||
if (specificOrder !== null && existingEntry.order !== specificOrder) isChanged = true;
|
||
if (specificDepth !== null && existingEntry.depth !== specificDepth) isChanged = true;
|
||
|
||
if (isChanged) {
|
||
existingEntry.content = content;
|
||
existingEntry.key = keys;
|
||
|
||
existingEntry.exclude_recursion = excludeRecursion;
|
||
existingEntry.prevent_recursion = excludeRecursion;
|
||
existingEntry.excludeRecursion = excludeRecursion;
|
||
existingEntry.preventRecursion = excludeRecursion;
|
||
|
||
if (specificOrder !== null) {
|
||
existingEntry.order = specificOrder;
|
||
existingEntry.position = 4;
|
||
}
|
||
if (specificDepth !== null) {
|
||
existingEntry.depth = specificDepth;
|
||
}
|
||
|
||
if (type === 'constant') {
|
||
existingEntry.constant = true;
|
||
} else {
|
||
existingEntry.constant = false;
|
||
}
|
||
existingEntry.enabled = enabled;
|
||
delete existingEntry.disable;
|
||
delete existingEntry.disabled;
|
||
|
||
entriesToUpdate.push(existingEntry);
|
||
}
|
||
} else {
|
||
entriesToCreate.push({
|
||
comment: comment,
|
||
keys: keys,
|
||
content: content,
|
||
type: type,
|
||
position: 4,
|
||
order: specificOrder !== null ? specificOrder : depth,
|
||
depth: specificDepth !== null ? specificDepth : depth,
|
||
enabled: enabled,
|
||
exclude_recursion: excludeRecursion,
|
||
prevent_recursion: excludeRecursion,
|
||
excludeRecursion: excludeRecursion,
|
||
preventRecursion: excludeRecursion
|
||
});
|
||
}
|
||
};
|
||
|
||
if (role === 'database') {
|
||
const indexKey = [`Amily_Index_${tableName}`,'索引'];
|
||
const indexComment = `[Amily2] Index for ${tableName}`;
|
||
let indexContent = `【${tableName} 索引】\n${indexText.trim()}`;
|
||
|
||
if (tableName.includes("大纲")) {
|
||
indexContent += `\n<system_note>\n【Amily2-前瞻性预测指令】\n为了实现“提前一轮触发绿灯世界书”的高级记忆回流,请在生成本轮回复时,根据当前剧情走向,**大胆预测并自然提及**下一轮可能出现的索引编码。可自行增加一个标签并使用<!--到-->html注释掉该编码。这将激活系统的预加载机制,确保剧情发展的连贯性。\n</system_note>`;
|
||
}
|
||
|
||
const indexType = isIndexConstant ? 'constant' : 'selective';
|
||
processEntry(indexComment, indexKey, indexContent, indexType, true, true, 0, 0);
|
||
}
|
||
|
||
const settings = extension_settings[extensionName] || {};
|
||
const optimizationEnabled = settings.context_optimization_enabled !== false;
|
||
|
||
const renderRowContent = (row) => {
|
||
let finalHeaders = headers;
|
||
if (!finalHeaders || finalHeaders.length < row.length) {
|
||
finalHeaders = [];
|
||
for (let i = 0; i < row.length; i++) {
|
||
finalHeaders.push((headers && headers[i]) ? headers[i] : `Col_${i}`);
|
||
}
|
||
}
|
||
|
||
let entryContent;
|
||
if (optimizationEnabled) {
|
||
const primaryVal = row[0] || 'Unknown';
|
||
entryContent = `【${tableName}档案: ${primaryVal}】\n`;
|
||
for (let i = 0; i < row.length; i++) {
|
||
const key = finalHeaders[i] || `Col_${i}`;
|
||
const val = row[i] || '';
|
||
entryContent += `- ${key}: ${val}\n`;
|
||
}
|
||
} else {
|
||
let textContent = `【${tableName} 详情】\n`;
|
||
for (let i = 0; i < row.length; i++) {
|
||
const key = finalHeaders[i] || `Col_${i}`;
|
||
const val = row[i] || '';
|
||
textContent += `- ${key}: ${val}\n`;
|
||
}
|
||
entryContent = textContent.trim();
|
||
}
|
||
return entryContent.trim();
|
||
};
|
||
|
||
data.forEach((row, index) => {
|
||
if (!row || row.length === 0) return;
|
||
|
||
const rawVal = row[0];
|
||
if (rawVal === undefined || rawVal === null) return;
|
||
|
||
const primaryVal = String(rawVal).trim();
|
||
if (primaryVal === '') return;
|
||
|
||
const isPendingDeletion = rowStatuses && rowStatuses[index] === 'pending-deletion';
|
||
const isEnabled = !isPendingDeletion;
|
||
|
||
const triggerKeys = [primaryVal];
|
||
const entryComment = `[Amily2] Detail: ${tableName} - ${primaryVal}`;
|
||
|
||
// 首行常驻:第一行通常是总调/全局定义(基调、主线目标等),
|
||
// 绿灯模式下没人提到其主键就永远不注入;开启后升为蓝灯常驻。
|
||
const entryType = (pinFirstRow && index === 0) ? 'constant' : 'selective';
|
||
|
||
processEntry(entryComment, triggerKeys, renderRowContent(row), entryType, isEnabled);
|
||
});
|
||
|
||
const entriesToDelete = [];
|
||
const tablePrefix = `[Amily2] Detail: ${tableName} -`;
|
||
|
||
const activeKeys = new Set();
|
||
for(const row of data) {
|
||
if(row && row.length > 0) {
|
||
const rVal = row[0];
|
||
if (rVal !== undefined && rVal !== null) {
|
||
const sVal = String(rVal).trim();
|
||
if (sVal !== '') {
|
||
activeKeys.add(sVal);
|
||
}
|
||
}
|
||
}
|
||
}
|
||
|
||
console.log(`[Amily2-Bridge-GC] ${tableName} 的活跃主键 (Active Keys):`, Array.from(activeKeys));
|
||
|
||
for (const entry of entries) {
|
||
if (entry.comment && entry.comment.startsWith(tablePrefix)) {
|
||
const entryKey = entry.comment.substring(tablePrefix.length).trim();
|
||
|
||
if (!activeKeys.has(entryKey)) {
|
||
console.log(`[Amily2-Bridge-GC] 发现残留条目 (将删除): ${entry.comment} (Key: ${entryKey})`);
|
||
entriesToDelete.push(entry.uid);
|
||
}
|
||
}
|
||
}
|
||
|
||
if (entriesToDelete.length > 0) {
|
||
console.log(`[Amily2-Bridge] 清理 ${entriesToDelete.length} 个废弃条目...`);
|
||
await amilyHelper.deleteLorebookEntries(bookName, entriesToDelete);
|
||
}
|
||
|
||
if (entriesToUpdate.length > 0) {
|
||
console.log(`[Amily2-Bridge] 更新 ${entriesToUpdate.length} 个条目...`);
|
||
await amilyHelper.setLorebookEntries(bookName, entriesToUpdate);
|
||
}
|
||
|
||
if (entriesToCreate.length > 0) {
|
||
console.log(`[Amily2-Bridge] 创建 ${entriesToCreate.length} 个新条目...`);
|
||
await amilyHelper.createLorebookEntries(bookName, entriesToCreate);
|
||
}
|
||
|
||
if (entriesToDelete.length === 0 && entriesToUpdate.length === 0 && entriesToCreate.length === 0) {
|
||
console.log(`[Amily2-Bridge] ${tableName} 无需变更 (数据一致)。`);
|
||
}
|
||
|
||
console.log(`[Amily2-Bridge] 同步完成: ${tableName}`);
|
||
}); // end withLoreLock
|
||
}
|
||
|
||
export async function ensureMemoryBook() {
|
||
const bookName = getMemoryBookName();
|
||
return withLoreLock(`ensureMemoryBook(${bookName})`, () => _doEnsureBook(bookName));
|
||
}
|
||
|
||
function createEntryTemplate() {
|
||
return {
|
||
uid: Date.now() + Math.floor(Math.random() * 1000),
|
||
key: [],
|
||
keysecondary: [],
|
||
comment: "",
|
||
content: "",
|
||
constant: false,
|
||
selective: true,
|
||
order: 100,
|
||
position: 1,
|
||
enabled: true
|
||
};
|
||
}
|
||
|
||
export async function updateTransientHint(hint) {
|
||
console.log('[Amily2-Bridge] 更新瞬时记忆提示...');
|
||
await ensureMemoryBook();
|
||
const bookName = getMemoryBookName();
|
||
|
||
const comment = "[Amily2] Active Memory Hint";
|
||
const content = hint ? `\n<system_note>\n【重要记忆回响】\n${hint}\n</system_note>\n` : "";
|
||
const enabled = !!hint;
|
||
|
||
let entries = await amilyHelper.getLorebookEntries(bookName);
|
||
if (!entries) entries = [];
|
||
|
||
const existingEntry = entries.find(e => e.comment === comment);
|
||
|
||
if (existingEntry) {
|
||
existingEntry.content = content;
|
||
existingEntry.enabled = enabled;
|
||
existingEntry.order = 0;
|
||
existingEntry.constant = true;
|
||
|
||
await amilyHelper.setLorebookEntries(bookName, [existingEntry]);
|
||
} else if (hint) {
|
||
const newEntry = {
|
||
comment: comment,
|
||
keys: [],
|
||
content: content,
|
||
constant: true,
|
||
selective: false,
|
||
order: 0,
|
||
position: 0,
|
||
enabled: true
|
||
};
|
||
await amilyHelper.createLorebookEntries(bookName, [newEntry]);
|
||
}
|
||
|
||
console.log(`[Amily2-Bridge] 瞬时记忆提示已${enabled ? '启用' : '清除'}。`);
|
||
}
|