a pNjZ@s ddlZddlZddlZddlZddlZddlZddlmZddlm Z dZ ee  j ZdZeddZeddZedd Zedd Zed Zed Zed ZedZddgZdgZgdZdgZgdZedZedZedZdZ ee Z!dZ"dZ#dZ$ia%ddZ&e'ddd Z(ed!d"d#Z)ed!d$d%Z*d&d'Z+ed!d(d)Z,e'e'e-d*d+d,Z.e'd-d.d/Z/ee'e'd0d1d2Z0d3d4Z1d5d6Z2d7d8Z3d9d:Z4d;d<Z5d=d>Z6d?d@Z7dAdBZ8dCdDZ9dEdFZ:e'dGdHdIZ;dRdKdLZe?dQkre>dS)SN)Path)quotez7https://files.vmvproductions.net/downloads/FikaSPT4_DB/ manifestszclient_mods_manifest.jsonzserver_mods_manifest.jsonzdb_include_index.jsonz.rebuild_db_include_indexinclude_list.txtinclude_fika_client.txtexclude_list.txtexclude_fika_client.txtzBepInEx/patcherszBepInEx/pluginsz SPT/user/mods)zBepInEx/plugins/sptzBepInEx/plugins/Fikaz!BepInEx/patchers/spt-prepatch.dllzSPT/user/mods/fika-server) rlogsz&fika_unified_generator_and_notifier.pyfika_changelog_cache.jsonfika_hash_cache.jsonrrrr r r r zfika_unified.logizyhttps://discord.com/api/webhooks/1429795721560854638/jE04Pl-PICQQU3-A0Pywlw7eE5Le4JkV9EvqHsDP9hM1YbfskaTcV3KE4e08GVFAveO1cCstjdddtsdStjtkr,dSttdt}|rN| t tdddD]>}ttd|}ttd|d}|r^| |q^ttd}t |dS)NTparentsexist_ok.rz.1) LOG_DIRmkdirLOG_FILEexistsstatst_size MAX_LOG_SIZE BASE_LOG_NAME MAX_LOG_FILESunlinkrangerename)ZoldestisrcZdstZrotatedr"d/mnt/user/appdata/webserver-php8.4/html/downloads/FikaSPT4_DB/fika_unified_generator_and_notifier.py rotate_logsls r$)msgcCsrtjdddtd}|d|}t|ddtjddd}||d Wdn1sd0YdS) NTrz[%Y-%m-%d %H:%M:%S] )flushautf-8encoding )rrtimestrftimeprintropenwrite)r%Ztslinefr"r"r#logs   r4)pathc Csz>|jddd}t|WdWS1s20YWnTtyT|YSty}z(td|jd|d|WYd}~Sd}~00dS)Nrr)r*u ⚠️ Failed to read JSON from : u — using default.)r0jsonloadFileNotFoundError Exceptionr4name)r5defaultr3er"r"r# load_jsons. r?cCsn|jjddd||jd}|jddd"}tj||ddd Wdn1sV0Y||dS) NTrz.tmpwr)r*rF)indentZ ensure_ascii)parentrZ with_suffixsuffixr0r8dumpreplace)r5datatmpr3r"r"r# save_jsons 0rHcs<g}|D].}|tfdd|Dr,q||q|S)z:Remove items that were excluded due to protected_prefixes.c3s$|]}|kp|dVqdS)/N) startswith.0pZrlr"r# z,filter_protected_removals..)loweranyappend)Z removed_listprotected_prefixesoutrelr"rNr#filter_protected_removalss rWcCsv|s gSg}|jdddD}|D].}|}|r$|dr@q$||ddq$Wdn1sh0Y|S)zi Read non-empty, non-comment lines from a text file and normalize to POSIX-style separators. r6r)r*#\rIN)rr0striprJrSrE)r5linesr3rawr2r"r"r# load_patternss2r])rel_pathprefixreturncCs$|d}||krdS||dS)z8True if rel_path is exactly prefix or directly under it.rIT)rstriprJ)r^r_r"r"r#is_prefix_matchs rbr^cstfdd|DS)Nc3s|]}t|VqdSNrbrKrcr"r#rOrPz!should_exclude..)rR)r^Zexcludesr"rcr#should_excludesrf)r5rel_keyr`c Cs|}|j}t|j}t|}|rJ|d|krJ|d|krJ|dSt}|d,}| d}|snqz| |q^Wdn1s0Y| } | ||dt|<| S)zm SHA1 hash with caching by relative key. Cache entry: { "hash": ..., "size": ..., "mtime": ... } sizemtimehashrbiN)rjrhri) rrintst_mtime HASH_CACHEgethashlibZsha1r0readupdateZ hexdigest) r5rgstrhricachedhr3chunkdigestr"r"r# quick_hashs     *rxc#st}|D]}|}|sq t|}|s>td|q |r|dd}|}|}||vs t||rrq | |t ||}||fVq t |D] \} } } t | t} | dd} | }g}| D]J}| dkr| d|n|}|tfdd|Drq||q|| dd<| D]t}t | |t}|dd}|}||vrnq2t||r~q2| |t t | ||}||fVq2qq dS)z Walk the given root-relative paths (dirs or files) and yield (rel_path, hash) pairs, preserving ORIGINAL CASE for output. All exclusion/prefix logic is done using lowercase copies. u ⚠️ Included path not found: rYrIrc3s|]}t|VqdSrdrerKZ sub_rel_lowerr"r#rOrPzwalk_roots..N)setrZBASE_DIRrr4is_filerErQrfaddrxoswalkr relative_toas_posixrRrS)Zroot_rel_pathsZexclude_prefixesseenZroot_relZ root_pathrVrel_norm rel_lowerrwdirpathdirnames filenamesdir_rel dir_rel_normZ dir_rel_lowerpruneddZsub_relfnamer"ryr# walk_rootssR            rc Cstt}ttt|}tt}ddt|D}td||rTtd|g}i}t ||D]2\}}t t |dd}| |||d|||<qf|j dd d tt|} td || d } tt| td tdt|d| |fS)a  Client manifest: - roots: BepInEx/patchers, BepInEx/plugins + include_list.txt - excludes: CLIENT_EXCLUDES + exclude_list.txt - output: manifests/client_mods_manifest.json - also writes protected_prefixes for GUI to ignore/prune-around cSsg|]}|dqSz/\rQrarKr"r"r# 5rPz)build_client_manifest..u🧭 Client scan roots: u)🧹 Client protected/excluded prefixes: rIZsafer<rjZurlcSs|dSNr<r"xr"r"r#IrPz'build_client_manifest..key%a %b %d %H:%M:%S %Z %Y generated_atfilesrTu📝 Client manifest written:  ( files))r] INCLUDE_LISTlistdictfromkeys CLIENT_ROOTS EXCLUDE_LISTCLIENT_EXCLUDESr4rBASE_URLrrSsortsortedrzr-r.rHCLIENT_MANIFEST_PATHlen Z extra_rootsZ all_rootsZextra_excludesZ all_excludesrmappingrVrwZsafe_urlrTmanifestr"r"r#build_client_manifest's4   rc Cstt}ttt|}tt}ddt|D}td||rTtd|g}i}t ||D]2\}}t t |dd}| |||d|||<qf|j dd d tt|} td || d } tt| td tdt|d| |fS)a Server manifest: - roots: SPT/user/mods + include_fika_client.txt - excludes: SERVER_EXCLUDES + exclude_fika_client.txt - output: manifests/server_mods_manifest.json - also writes protected_prefixes for GUI to ignore/prune-around cSsg|]}|dqSrrrKr"r"r#rbrPz)build_server_manifest..u🧭 Server scan roots: u)🧹 Server protected/excluded prefixes: rIrrcSs|dSrr"rr"r"r#rvrPz'build_server_manifest..rrru📝 Server manifest written: rr)r]INCLUDE_FIKA_CLIENTrrr SERVER_ROOTSEXCLUDE_FIKA_CLIENTSERVER_EXCLUDESr4rrrrSrrrzr-r.rHSERVER_MANIFEST_PATHrrr"r"r#build_server_manifestVs4   rcCsdtjdd}|dvr1trueZforceZyesZonZ$FIKA_REBUILD_DB_INCLUDE_INDEX_REASONzwatcher requestT)Tz db_include_index.json is missingzmanual flag present: )Fz#no DB Include-only changes detected) r~environrorZrQDB_INCLUDE_INDEX_PATHrDB_INCLUDE_INDEX_REBUILD_FLAGr<)r\reasonr"r"r#should_rebuild_db_include_indexs rc CsLztrtWn2tyF}ztd|WYd}~n d}~00dS)Nu0⚠️ Could not clear DB Include rebuild flag: )rrrOSErrorr4)r>r"r"r#clear_db_include_rebuild_flags  rc CsddtD}g}i}g}t}t}ttD]6\}}}t|t} | dkrZdn | dd} g} |D]`} | r| d| n| } | }t ||rqn| | ||vrn| || | dddqn| |dd<|D]}t||t}|dd}| }||vst ||r$q| |t t|||}| ||tt|ddd |||<qq0|jd d d |jtj d |||fS) aInventory every downloadable DB file and directory once. The two normal manifests remain authoritative for their own sync scopes. This index is intentionally broader: it is used only when a server admin explicitly selects a DB Include path outside those manifests. cSsg|]}|dqSrrrKr"r"r#rrPz)scan_db_include_index..rrrYrINrrcSs |dSr)rQ)itemr"r"r#rrPz'scan_db_include_index..r)DB_INCLUDE_INDEX_EXCLUDESrzr~rr{rrrrErQrfrSr}rxrrrstr)ZexcludedrrfoldersZ seen_filesZ seen_foldersrrrrrrdirnameZ child_relZ child_lowerrrVrrrwr"r"r#scan_db_include_indexsJ       rcCsFdtd||d}tt|tdtdt|dt|d|S)z;Atomically publish the Include index after the settle scan.rr)Zschemarrru"🗂️ DB Include index written: rz files, z folders))r-r.rHrr4r)rrrr"r"r#write_db_include_indexs $rcCs*tti}|di}|di}||fS)Nclientserver)r? STATE_FILEro)rFZ client_prevZ server_prevr"r"r#load_last_states   rcCs||d}tt|dS)N)rr)rHr) client_map server_maprFr"r"r# save_statesrcsVt}t}t||}t||}tfdd||@D}|||fS)Nc3s"|]}||kr|VqdSrdr")rLkcurrentpreviousr"r#rOszdiff_maps..)rzkeysr)rrZcur_keysZ prev_keysaddedremovedupdatedr"rr# diff_mapss    r)contentc CststddSzdtd|i}tjdddddd d |tg d d d }|jd krjtd|jd|jntdWn2t y}ztd|WYd}~n d}~00dS)uW Send Discord webhook without 'requests' — uses curl so Unraid always works. u5⚠️ WEBHOOK_URL not set — skipping Discord post.NrZcurlz-sz-HzContent-Type: application/jsonz-XZPOSTz-dT)Zcapture_outputtextru⚠️ curl failed with code r7u*📨 Posted changelog to Discord via curl.u(⚠️ Failed to send webhook via curl: ) WEBHOOK_URLr4r8dumps subprocessrun returncodestderrrZr;)rZpayloadresultr>r"r"r#send_discord_messages*  rrcsJd|dgdfdd}|dd||dd ||d d |S) zG Build Discord formatted section for one side (Client/Server). u — u —(csx|sdS|dt|d|dD]}d|d|q.t|krtdt|ddS)Nrz):z r&u … and z more)rSr)ZlabelZmarkeritemsr3r[Zmax_listr_r"r# add_block+s z!format_section..add_blocku ➕ Added+u 🟠 Updated~u ➖ Removed-r")titlerrrr_rr"rr#format_section$s   rcCsZ|\}}}|s"|s"|s"tddSdg}|td|||dd|d}t|dS)NuE✔️ No new CLIENT file changes detected — skipping Discord post.zUpdate summary for Fika Mods:zClient changesz``` r,z ```)r4extendrjoinr) client_diff server_diffZc_addedZ c_updatedZ c_removedr[r%r"r"r#post_changelog;s  rc Cs&ttdttiatdttdt\}}t\}}t t t\}}t\}}dd}|||} |||} t \} } | rtd| dt \} }}t | |tntd| dt|t| krtd t|t| krtd |}|}ttttd ttdt\}}t| |}t| |}|d g}|d g}t|d |}t|d |}|d|d|f}|d|d|f}tdt|ddt|ddt|d tdt|ddt|ddt|d t||t| | tdtdtddS)Nu&🚀 Running Fika unified generator...u📚 Loaded hash cache with z entries.csfdd|DS)Ncs*i|]"\}}|vr||kr||qSr"r")rLrvmap1r"r# tsz-main..stable_only..)r)rZmap2r"rr# stable_onlyss zmain..stable_onlyu/🗂️ DB Include index rebuild requested — ru'🗂️ DB Include index unchanged — uB🕒 Some client files still uploading — deferred until next runuB🕒 Some server files still uploading — deferred until next runu💾 Hash cache updated with rTrrru🧾 Client changes — Added: z , Updated: z , Removed: u🧾 Server changes — Added: u💾 Change-state saved.u%✅ Fika unified generator completed.z<------------------------------------------------------------)r$r4r?HASH_CACHE_FILErnrrrr-sleepSETTLE_DELAY_SECONDSrrrrrHrrrorWrr)Zclient_manifest_1Z client_map_1Zserver_manifest_1Z server_map_1Zclient_manifest_2Z client_map_2Zserver_manifest_2Z server_map_2rrrZrebuild_include_indexZinclude_index_reasonZinclude_index_filesZinclude_index_mapZinclude_index_foldersZclient_manifestZserver_manifestZ prev_clientZ prev_serverZclient_diff_rawZserver_diff_rawZclient_protectedZserver_protectedZclient_removed_filteredZserver_removed_filteredrrr"r"r#mainSs                       r__main__)r)@r~sysr-r8rprpathlibrZ urllib.parserr__file__ZresolverBr{rrrrrrrrrrrrrrrrrrrrrrrnr$rr4r?rHrWr]boolrbrfrxrrrrrrrrrrrrrr__name__r"r"r"r# sz            B/04! v