Skip to content

chore: re-add baba-is-ai demo to the bundled library #61

Description

@JNK234

Roadmap priority: B16

Summary

Re-add the baba-is-ai demo to the bundled library. It was pulled during the v1.0.0 library submission over a config-file issue flagged in review.

Why it matters

It is one of the more research-grounded demos — it reproduces the knowing-doing gap from BALROG (arXiv:2411.13543), where LLMs score near zero on spatial puzzle games despite being able to state the correct rule. Good demonstration material and a genuine research result.

What needs to be done

  1. Recover the exact reviewer note from the NetLogo-Libraries submission — the issue was an extensionless config file that did not fit the bundle conventions.
  2. Rename or restructure the config so it conforms (compare demos/tests/config.txt.example and the other bundled demos).
  3. Verify the demo runs against a current default model — it was built against Ollama qwen2.5:7b.
  4. Re-run and confirm behaviour still reproduces the intended result.
  5. Re-submit to the library bundle.

Open questions

  • Is the config issue the only blocker, or were there other reviewer notes?
  • Should it ship with an Ollama config (free, offline, matches the original result) or a cloud config (faster to demo)?

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions