rootandClaude Opus 5.5
36dc048e89
Title recognition (parseRelease / parseReleasePath):
- anime prefix tags (★N月新番, [国漫], 【22年日剧】), category lead bracket, `A / B` cn aliases
- `Name [01]`, `[TV 04]`, `#13`, `名称 12.mkv`, `S01 13-14`, `E13-14` episodes
- lead bracket as title vs group, trailing [Group], YTS.MX/Hall_of_C style groups, 字幕组 suffix
- `[dot.release.name][…]` unbracketing, `Season 2017` as year, leading date not airDate,
date-only parent dir does not merge as TV
- original disc: Blu-ray + AVC/HEVC/VC-1/MPEG-2 without x26x/H.26x -> BluRay-Disc
- `{[tmdbid=;type=;s=;e=]}` explicit block, bangumi/anilist ids
- bare [1080]/[5.1], DTS-HD MA5.1, ￡ multi-group, 合集, pinyin title -> cn from subtitle,
streaming platform table, CHS/CHT/GB/BIG5 in subtitle
zh-map: add 迴滾魷瑯臥駭; document one-to-many chars kept out.
Sites: tbody branch + header-row tightening via movieclaw-import rowSelector (18 definitions),
row-level case/hr/labels include the row itself, subtitle branch (searchType: "subtitles"),
parseSizeMp banker's rounding.
Differential snapshots regenerated; MP test sample sources registered in ledger.
Co-Authored-By: Claude Opus 5.5 <[email protected]>
10 KiB
10 KiB
MoviePilot 跟随移植账本(mp-sync)
许可结论(引自
license-and-provenance.md):MoviePilot 为 GPLv3;本目录登记的站点框架文件是用户 2026-09-27 明确要求"照抄 MP v3 实现迁移"的数据来源适配部分,每个移植文件头保留SPDX-License-Identifier: GPL-3.0-only与来源声明;MP 的闭源/加密部分(sites.*.so、user.sites.v3.bin)不解密、不参考,站点定义改由 MovieClaw v0.27.0(MIT,copied-mit,见packages/adapters/src/sites/definitions/NOTICE-MovieClaw.md) 转换 + 手写覆盖。MovieClaw v0.27.0 之后改为附条件许可,不跟随其后续提交。
1. 机制
- 登记来源:每个移植文件头写
@mp-source <上游路径> @ <提交>(一个文件可多行);sites 目录外或 W1-3a/b 早期文件在scripts/mp-sync/ledger.manual.json人工登记。 - ledger:
scripts/mp-sync/ledger.json(build-ledger.mjs生成)按上游文件聚合:upstream、移植时commit、该文件在该提交的内容sha256、本项目文件ours[]。 - 监视目录:
app/modules/indexer/spider/、app/modules/indexer/parser/,出现 ledger 未收录的新文件即提示(MP 新增站点 spider/解析器)。
2. 用法
MP 本地仓库默认 /opt/moviepilot-plus/upstream/MoviePilot(浅克隆,当前 e6820a8)。以下命令 Node 24 或 deno run -A 均可(不依赖根 package.json / deno.json 任务)。
# 1) 取上游新提交(浅克隆)
git -C /opt/moviepilot-plus/upstream/MoviePilot fetch --depth=1 origin <新提交或 v3>
# 2) 查差异:已变更 / 已删除 / 监视目录新增,附逐文件 git diff 命令;有变化退出码 1
node scripts/mp-sync/check.mjs --to <新提交> # 或 --mp <路径> --json
# 3) 按 diff 增量移植 TS 文件,把文件头 @mp-source 的提交号改为新提交(新文件加标签)
# 4) 重建 ledger 与下表
node scripts/mp-sync/build-ledger.mjs --commit <新提交>
# 5) 跑适配器测试
cd packages/adapters && deno run -A npm:vitest run src/sites
MovieClaw 站点定义(与 MP 无关,但同属站点框架跟随工具):
node scripts/mp-sync/movieclaw-import.mjs # 从 v0.27.0 重新转换 23 个站点定义(覆盖层:scripts/mp-sync/movieclaw-overrides/)
node scripts/mp-sync/movieclaw-import.mjs --check # 只比较,有差异退出码 1
3. 当前对照总表
共 51 个上游文件(adapters/ = packages/adapters/src/)。
| 上游文件 | 本项目文件 | 移植提交 | sha256(前 12 位) | 来源 |
|---|---|---|---|---|
app/adapters/network/cloudflare.py |
adapters/sites/user-parsers/common.ts |
e6820a8 |
a23a2c44da05 |
tag |
app/application/mediaserver.py |
adapters/emby/client.ts |
e6820a8 |
f034f0be8ba6 |
manual |
app/application/rss.py |
adapters/rss/fetch.tsadapters/rss/parse.tsadapters/rss/rss-link.ts |
e6820a8 |
8ea70f712512 |
manual |
app/application/site/sites.pyi |
adapters/sites/definitions/schema.tsadapters/sites/registry.tsadapters/sites/spider/schema.ts |
e6820a8 |
8fea9a239354 |
manual |
app/chain/download/submission.py |
adapters/sites/mteam/adapter.tsadapters/sites/spider/adapter.tsadapters/sites/spiders/common.ts |
e6820a8 |
f7cb870e47d6 |
manual+tag |
app/domain/site.py |
adapters/sites/user-parsers/common.ts |
e6820a8 |
650c795a4def |
tag |
app/foundation/dom.py |
adapters/sites/user-parsers/dom.ts |
e6820a8 |
6d6accf2cef1 |
tag |
app/foundation/size.py |
adapters/sites/spider/spider.ts |
e6820a8 |
7b0b8f50588c |
manual |
app/foundation/temporal.py |
adapters/sites/spiders/common.tsadapters/sites/user-parsers/common.ts |
e6820a8 |
74941f460e40 |
tag |
app/foundation/text.py |
adapters/sites/user-parsers/common.ts |
e6820a8 |
a88c75dc8431 |
tag |
app/modules/__init__.py |
adapters/qbittorrent/paths.ts |
e6820a8 |
2edada0ea591 |
manual |
app/modules/_base/downloader.py |
adapters/qbittorrent/torrent.ts |
e6820a8 |
84bd8946c8b2 |
manual |
app/modules/emby/emby.py |
adapters/emby/client.ts |
e6820a8 |
e6468ea34ef2 |
manual |
app/modules/filemanager/storages/local.py |
adapters/fs/copy.tsadapters/fs/move.ts |
e6820a8 |
806a1970ca8e |
manual |
app/modules/filemanager/transhandler.py |
adapters/fs/move.ts |
e6820a8 |
13e2bba491ac |
manual |
app/modules/indexer/__init__.py |
adapters/sites/registry.tsadapters/sites/spider/adapter.tsadapters/sites/spiders/adapter.tsadapters/sites/spiders/index.tsadapters/sites/spiders/map.tsadapters/sites/spiders/types.tsadapters/sites/user-parsers/registry.ts |
e6820a8 |
e9c5d15fdaa5 |
manual+tag |
app/modules/indexer/parser/__init__.py |
adapters/sites/user-parsers/base.tsadapters/sites/user-parsers/types.ts |
e6820a8 |
0e6c4215b713 |
tag |
app/modules/indexer/parser/bitpt.py |
adapters/sites/user-parsers/bitpt.ts |
e6820a8 |
871d25e570f1 |
tag |
app/modules/indexer/parser/discuz.py |
adapters/sites/user-parsers/discuz.ts |
e6820a8 |
12277ba955ce |
tag |
app/modules/indexer/parser/file_list.py |
adapters/sites/user-parsers/file-list.ts |
e6820a8 |
f92e65ed7327 |
tag |
app/modules/indexer/parser/gazelle.py |
adapters/sites/user-parsers/gazelle.ts |
e6820a8 |
c10e5246724b |
tag |
app/modules/indexer/parser/hddolby.py |
adapters/sites/user-parsers/hddolby.ts |
e6820a8 |
a4336d92d603 |
tag |
app/modules/indexer/parser/ipt.py |
adapters/sites/user-parsers/ipt.ts |
e6820a8 |
2b9d04d76606 |
tag |
app/modules/indexer/parser/mtorrent.py |
adapters/sites/user-parsers/mtorrent.ts |
e6820a8 |
c5d5a3c6f9f5 |
tag |
app/modules/indexer/parser/nexus_audiences.py |
adapters/sites/user-parsers/nexus-audiences.ts |
e6820a8 |
1a2d104db769 |
tag |
app/modules/indexer/parser/nexus_hhanclub.py |
adapters/sites/user-parsers/nexus-hhanclub.ts |
e6820a8 |
8850619069d4 |
tag |
app/modules/indexer/parser/nexus_php.py |
adapters/sites/user-parsers/nexus-php.ts |
e6820a8 |
39303ae96d9c |
tag |
app/modules/indexer/parser/nexus_project.py |
adapters/sites/user-parsers/nexus-project.ts |
e6820a8 |
2b5508cfb2f8 |
tag |
app/modules/indexer/parser/nexus_rabbit.py |
adapters/sites/user-parsers/nexus-rabbit.ts |
e6820a8 |
09149b89a7c7 |
tag |
app/modules/indexer/parser/rousi.py |
adapters/sites/user-parsers/rousi.ts |
e6820a8 |
1b1ea93de084 |
tag |
app/modules/indexer/parser/small_horse.py |
adapters/sites/user-parsers/small-horse.ts |
e6820a8 |
b73b5de97737 |
tag |
app/modules/indexer/parser/sunnypt.py |
adapters/sites/user-parsers/sunnypt.ts |
e6820a8 |
937f8453fa2b |
tag |
app/modules/indexer/parser/tnode.py |
adapters/sites/user-parsers/tnode.ts |
e6820a8 |
c9cb809fc4bf |
tag |
app/modules/indexer/parser/torrent_leech.py |
adapters/sites/user-parsers/torrent-leech.ts |
e6820a8 |
72d1473a3bba |
tag |
app/modules/indexer/parser/unit3d.py |
adapters/sites/user-parsers/unit3d.ts |
e6820a8 |
9a4d579deca5 |
tag |
app/modules/indexer/parser/yema.py |
adapters/sites/user-parsers/yema.ts |
e6820a8 |
0f98fd580bad |
tag |
app/modules/indexer/parser/zhixing.py |
adapters/sites/user-parsers/zhixing.ts |
e6820a8 |
90c8954e7387 |
tag |
app/modules/indexer/spider/__init__.py |
adapters/sites/spider/map.tsadapters/sites/spider/schema.tsadapters/sites/spider/spider.tsadapters/sites/spider/template.ts |
e6820a8 |
2513d962fa43 |
manual |
app/modules/indexer/spider/haidan.py |
adapters/sites/spiders/haidan.ts |
e6820a8 |
75eb802f19f0 |
tag |
app/modules/indexer/spider/hddolby.py |
adapters/sites/spiders/hddolby.ts |
e6820a8 |
46a50bd8d49f |
tag |
app/modules/indexer/spider/mtorrent.py |
adapters/sites/mteam/adapter.tsadapters/sites/mteam/client.tsadapters/sites/mteam/spider.tsadapters/sites/spiders/mtorrent.ts |
e6820a8 |
a8ab2b822cb2 |
manual+tag |
app/modules/indexer/spider/rousi.py |
adapters/sites/spiders/rousi.ts |
e6820a8 |
aa13c386a560 |
tag |
app/modules/indexer/spider/sunnypt.py |
adapters/sites/spiders/sunnypt.ts |
e6820a8 |
735b0d721e65 |
tag |
app/modules/indexer/spider/tnode.py |
adapters/sites/spiders/tnode.ts |
e6820a8 |
a3634a268dba |
tag |
app/modules/indexer/spider/torrentleech.py |
adapters/sites/spiders/torrentleech.ts |
e6820a8 |
c965f2bcaea4 |
tag |
app/modules/indexer/spider/yema.py |
adapters/sites/spiders/yema.ts |
e6820a8 |
560b62c1ff10 |
tag |
app/modules/qbittorrent/qbittorrent.py |
adapters/qbittorrent/client.tsadapters/qbittorrent/state.ts |
e6820a8 |
ab02e97e986f |
manual |
app/modules/themoviedb/tmdbapi.py |
adapters/tmdb/client.tsadapters/tmdb/match.ts |
e6820a8 |
787553a6f57d |
manual |
app/schemas/site.py |
adapters/sites/user-parsers/types.ts |
e6820a8 |
e7952ed40b7b |
tag |
tests/cases/meta.py |
packages/domain/test/differential/meta-mp.jsonpackages/domain/test/differential/meta-samples.json |
e6820a8 |
3af375cf2c43 |
manual |
tests/test_rust_accel.py |
packages/adapters/test/differential/indexer.jsonscripts/mp-sync/gen-differential.py |
e6820a8 |
0259f245d278 |
manual |
4. 移植时的统一偏离(每个文件头另有细节)
- 凭据不进候选/结果:MP 两段式 enclosure(
[base64(含 apikey 的请求配置)]url)不生成,下载时由 adapter 现场换直链;用户信息raw不含 cookie/apikey/token。 - 错误显式化:MP spider 的
(is_error, [])改为抛SiteError{kind};用户信息解析保留 MP 的err_msg语义,另记脱敏的http_errors。 - 翻页上限:做种/消息翻页最多 50 页(MP 无上限)。
- XPath:lxml →
xpath+@xmldom/xmldom(经 htmlparser2 解析,不插入 tbody),见user-parsers/dom.ts。 - dateparser:只实现绝对时间格式,相对时间原样返回(待核验)。
- 写操作门控:读取站内信后标记已读(MTorrent/Rousi/NexusRabbit)只在
fetchMessages=true时发生(MP 由全局SITE_MESSAGE控制)。