Commit Graph

8 Commits

Author SHA1 Message Date
PM-pinou 8fa36b774e v7: 19 issues fixed — SQLite storage, new clustering pipeline, display_id, globe rewrite, Chinese tools
Key changes:
- New: data_loader.py SQLite persistence with drop_sqlite_table
- New: db_utils.py retry_on_lock decorator (3 retries, exponential backoff)
- New: tool_registry.py with 27 MCP tools (filter_and_cluster, compute_scores, etc.)
- New: tls_ref.py for TLS cipher/reference data
- New: import_tlsdb.py management command
- New: scripts/start_server.py for portable runtime
- New: migrations 0003-0007 for SQLite table, display_id, llm fields
- Changed: views.py unified pipeline worker, retry_run, display_id everywhere
- Changed: models.py with display_id auto-assignment, run_type, sqlite_table, llm_thinking, tool_calls_json
- Changed: urls.py added retry_run route
- Changed: session_store.py robust JSON persistence
- Changed: AGENTS.md v7 fix summary added
- Changed: templates — globe rewrite (inertia/polar flip), auto.html (thinking/tool accordions), base.html (toast/config), all pages use display_id
- Changed: run.bat PYTHONUTF8=1
- Deleted: entity_detector.py, entity_aggregator.py (replaced by filter_and_cluster clustering pipeline)
- Test: 92/92 unit tests passing
2026-07-20 13:33:13 +08:00
PM-pinou 7af05ab97a docs: update AGENTS.md with MCP tool system + cleanup 2026-07-19 23:20:29 +08:00
PM-pinou aab354cc51 v4: progress bar position + sklearn warning + N+1 fix + PRAGMA opt + zero-var fallback 2026-07-17 19:07:57 +08:00
PM-pinou fa305515c1 fix: D5 downsampling index mismatch + add 1M-row medium-scale test to docs 2026-07-17 14:02:30 +08:00
PM-pinou 70e2167fea docs: update AGENTS.md with v3 fix status for all 7 issues 2026-07-17 13:33:12 +08:00
PM-pinou 2bb3b7273a xiufu: fix globe ?data=, add pipeline tests, update settings, rewrite AGENTS.md
- Fix globe_view ?data= 500 error (try/except safety + DATA_UPLOAD_MAX_NUMBER_FIELDS=1000000)
- Add test_pipeline.py (8 tests: 3 datasets × 2 algorithms + edge cases)
- Update AGENTS.md with all 18 issue statuses
- Clean up server processes
2026-07-16 23:54:19 +08:00
PM-pinou b1d7393921 deep merge: unify 3 pipeline flows + fix DB save race + add PCA to manual flow
- Create shared _run_clustering_pipeline() in views.py
- Manual POST, CLI, and LLM flows all call the same function
- Consistent asyncio.run() tool calls throughout (_handle_run_clustering,
  _handle_extract_features) - removed _cluster_sync
- Add PCA-2D embedding to manual flow (was CLI-only)
- Fix MultipleObjectsReturned in _handle_extract_features DB save:
  pass run_id from pipeline → use get() instead of get_or_create()
- 120/120 tests passing, CLI pipeline clean
2026-07-16 23:08:26 +08:00
PM-pinou 814f29645a chore: initial commit of 天璇 project state before cleanup 2026-07-16 22:41:26 +08:00