refactor(core): replace JSON-based pipeline with MySQL database

Browse Source

This commit introduces a major architectural overhaul, migrating the data backend from a flat JSON
file to a relational MySQL database.

- Replaced multiple scraping scripts with a unified `main.py` that handles crawling, parsing, and
database synchronization.
- Introduced `mysql_helper.py` for robust database interaction with a connection pool.
- Added `queries.sql` defining the new database schema for assets, categories, tags, and changelogs.
- Removed all obsolete frontend code (v1, v2) and old scraping scripts.

This change provides a more scalable and maintainable foundation for managing asset data.

...

This commit is contained in:

xiaomai

2025-09-14 23:11:00 +08:00

parent a8dd020c98

commit ad4462ef8a

18 changed files with 588 additions and 893 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

1

all_asset_infos.json Normal file

File diff suppressed because one or more lines are too long