Skip to content

BeaverHouse/aecheck-data-process

Repository files navigation

Logo

Data processing CLI for AE Check

Go Supabase Codex Windows only License


Description

Go CLI to update the data of the AE Check website.
Used Cobra for CLI framework.

History

Period Description
2021.02 ~ 2022.09 Manually processed the JSON data
2022.09 ~ 2023.09 Used python script to process data (v2)
2023.09 ~ 2024.10 Changed the data schema, configured auto-migration via GitHub Actions (v3)
2024.10 Migrated data to Supabase, deployed the backend (v3.1)
2025.11 Migrated data process code to Go
2026.02 Add data processing for tier info (3 sources)
2026.06 Advanced automation for scraping wiki home & Windows scheduling

Major data reference

Data source Description
Raw application I'm using mobile emulator to extract images directly.
altema.jp To scrape japanese data
AE wiki To scrape english data
Seesaa Wiki For additional information
Another Tier For tier reference

Limitation

  • Because data process needs mobile emulator, this repository is only runnable in Windows.
  • As of April 2026, AE wiki has enabled Cloudflare protection, blocking automated HTTP requests. So this CLI is semi-automatic; when a wiki URL is requested, a browser window opens; solve the Cloudflare challenge manually, then press Enter in the terminal to continue.

Documentation


Contributing

See the CONTRIBUTING.md.



Attribution

Logo icon is extracted from Another Eden APK.

About

Data processing CLI for AE Check

Resources

License

Code of conduct

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors