Skip to content
FreedomIntelligencePublic

About

A general framework for recursive self-improvement: build your own RSI system from interchangeable components

Resources

Stars

2 stars

Watchers

0 watching

Forks

Latest commit

 

History

40 Commits

Folders and files

Repository files navigation

RSISys

License: Apache 2.0 GitHub stars arXiv paper: Coming soon

A general framework for recursive self-improvement: choose what to improve and build your own RSI system from interchangeable components

English · 简体中文

Overview · News · Highlights · Getting started · Docs · Methods · Citation

RSISys runs recursive self-improvement (RSI) experiments as a loop. A Controller decides what to try next, Labs run the experiments and return receipts, and the Controller reads the evidence to choose its next step or the candidate to adopt. Prompt search, harness search, supervised fine-tuning and reinforcement learning share this loop, so you can swap a Controller, reuse a Lab, or add a method without changing the core.

Framework overview

RSISys architecture, in two panels. (a) The Controller requests operations from Domain Labs, which return trajectories, metrics, and artifacts as evidence. (b) The Self-Reflection Lab constructs a Controller update and can validate it in a nested trial. The current Controller decides whether to adopt the update.

A Controller decides what to try and what to adopt. Its Policy makes decisions, its Harness prepares inputs and tools, and optional Memory provides context. A Lab executes operations such as evaluation, sampling, or training against its configured inputs. The host routes calls, enforces budgets and split rules, and preserves receipts for recovery.

News

  • [2026-11] RSISys is open-sourced, with 16 built-in method registrations and support for durable runs.

Highlights

A general RSI framework built around the research loop. RSISys automates the human–AI research loop: the Controller chooses what to try, Labs run the experiments, and accumulated evidence guides what to try next or what to adopt. Different RSI methods use this structure with their own optimization algorithms.

Choose what to improve. A method can change an agent's prompts, programs, harness, or model weights. It can also change the RSI policy that decides how to improve. The Self-Reflection Lab can test a candidate Controller in a nested run, and the current Controller decides whether to adopt it based on the evidence.

Swap and reuse components. Controllers and Labs compose through public interfaces, and their policies, harnesses, memory, and backends can be replaced independently. Reuse the same Coding Lab with different compatible Controllers, or connect a new dataset or benchmark through a Lab, without changing the core. See how to compose a system.

Getting started

Install with Python 3.12 or 3.13 on Linux or macOS. The core has no third-party dependencies; methods list their optional extras.

git clone https://github.com/satsuki2486441738/RSISys.git
cd RSISys
python -m pip install -e .

Run a first experiment without a GPU. This runs two ReST^EM rounds on fixture data with a simulated model. It checks the installation and shows what a run produces.

rsisys run --config src/rsisys/algorithms/rest_em/configs/cpu/rest_em.json --data-dir runs/quickstart

Run with a GPU model. Start a Chat Completions endpoint, then run the method template, which searches prompt and few-shot settings:

rsisys run --plugin src/rsisys/labs/_template --plugin src/rsisys/algorithms/_template \
  --config src/rsisys/algorithms/_template/configs/run.json --data-dir runs/gpu-quickstart

The Quickstart explains how to read the results, watch runs in RSIMonitor, and resume interrupted runs.

Documentation

I want to… Read
Learn the terms: Controller, Lab, operation, receipt, split Concepts
See the built-in methods, Controllers, Labs, and components Components
Run a Controller on a different Lab, or load my own Controller Compose a system
Write a new method Method template
Write a Lab or connect my own benchmark Lab template
Look up a config field or CLI option Run configuration
Inspect and compare runs RSIMonitor

Adapted methods

Family Methods Controller (research) Lab (exploration) What improves
Self-training ReST^EM · STaR · TTRL · TTRL-verl Schedules generate, filter and train rounds The model samples answers, is scored and fine-tuned Model weights
Self-editing SEAL Schedules self-edit rounds The model writes its own training data and is updated Model weights (unified)
Prompt search OPRO · GEPA · GEPA-Merge · PromptPG Searches over candidate prompts A task model is evaluated with each prompt Prompts
Program search FunSearch Evolves a population of programs Programs are executed and scored Programs
Harness search RRSI · Meta-Agent · Coding Meta-Agent A model proposes harness changes An agent solves tasks with the candidate harness Agent harness
Reflection Reflexion Decides when to retry The same agent writes code, runs tests and reflects on failures Its own reflections (unified)
Research agents AIDE · FT-Agent The upstream agent drafts, debugs and selects solutions Candidate programs and fine-tuning jobs run Solutions and fine-tuned models
Self-reflection Self-Reflection Lab (a Lab, paired with a Controller) The current Controller Candidate Controllers run in nested experiments The Controller itself

Run rsisys catalog to list the registered methods. Components lists each method's presets, hardware, and dependencies. Guides exist for ReST^EM, GEPA, and Coding Meta-Agent; the other methods have presets but no guide yet. A preset is a starting point, not a verified reproduction of the paper.

Contributing

Start with the method template or the Lab template, and see Compose a system for plugins. For a new method or Lab, include a runnable configuration, state which results it has been checked against, and cite the source of any upstream adaptation. Import framework interfaces from rsisys.api.

Citation

If you find RSISys useful, please cite:

@misc{rsisys2026,
  title        = {RSISys: A Modular Runtime for Recursive Self-Improvement Research},
  author       = {{RSISys contributors}},
  year         = {2026},
  howpublished = {\url{https://github.com/satsuki2486441738/RSISys}}
}

License

RSISys is released under the Apache 2.0 License. Adapted upstream code keeps its attribution next to the implementation.

About

A general framework for recursive self-improvement: build your own RSI system from interchangeable components

Resources

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages