Skip to content

Add automatic testing and optimization recommendation modes - #52

Open
BingTong0 wants to merge 11 commits into
mainfrom
feature/optimization-recommendation
Open

BingTong0 wants to merge 11 commits into
mainfrom
feature/optimization-recommendation

Conversation

@BingTong0

Copy link
Copy Markdown
Contributor

Summary

This PR introduces automatic performance testing and optimization recommendation capabilities to the FinBench driver.

Changes

  • Add the AUTOMATIC_TEST mode for automatically estimating and tuning the time compression ratio.
  • Add configurable estimation time, accurate test time, error range, TCR range, and timeout rate.
  • Add the OPTIMIZATION_RECOMMENDATION mode.
  • Capture representative operations and profile their execution time, CPU usage, and memory usage.
  • Rank operation types according to their optimization potential.
  • Simulate configurable resource-reduction scenarios and rerun the complete workload to measure throughput impact.
  • Generate optimization reports in JSON and Markdown formats.
  • Introduce the optional OptimizationSupport interface for SUT-specific resource monitoring and synthetic workload execution.
  • Improve workload execution, result validation, and metric snapshot handling.
  • Add example property files and usage documentation for both new modes.
  • Add unit tests covering optimization analysis, representative-operation recording, and optimization recommendation execution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants