Skip to content

refactor llm lm_eval quantization and benchmark scripts - #2609

Merged
chensuyue merged 11 commits into
mainfrom
suyue/ruler
Oct 20, 2026
Merged

chensuyue merged 11 commits into
mainfrom
suyue/ruler

Conversation

@chensuyue

@chensuyue chensuyue commented Oct 8, 2026 •

Copy link
Copy Markdown
Contributor

Type of Change

llm examples refactor

Description

  1. Unify quantization and benchmark parameters.
  2. Use common lm_eval scripts for llm examples.

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
…equence length calculation

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
@chensuyue chensuyue changed the title refactor llm lm_eval benchmark scripts refactor llm lm_eval quantization and benchmark scripts Oct 8, 2026
@chensuyue
chensuyue requested review from thuang6, xin3he and yiliu30 and a balanced review from Copilot and removed request for Copilot October 8, 2026 07:57
…ove topology parameter

Signed-off-by: chensuyue <suyue.chen@intel.com>

@xin3he xin3he left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice skill

@yiliu30 yiliu30 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

…meters and streamline usage

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
…ification

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
@chensuyue
chensuyue merged commit d53e3c0 into main Oct 20, 2026
14 checks passed
@chensuyue
chensuyue deleted the suyue/ruler branch October 20, 2026 01:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants