Skip to content

feat: implement code city apocalypse dashboard#33

Open
BleakNarratives wants to merge 2 commits into
mainfrom
feat/code-city-dashboard-7778644714997318215
Open

feat: implement code city apocalypse dashboard#33
BleakNarratives wants to merge 2 commits into
mainfrom
feat/code-city-dashboard-7778644714997318215

Conversation

@BleakNarratives
Copy link
Copy Markdown
Owner

This PR transforms the AIRTBench frontend into a thematic 'Code City Apocalypse' dashboard.

Key changes:

  • Thematic UI: Custom CSS implementation featuring scanline effects, glitch text, and dynamic system integrity coloring.
  • Improved Metrics: Refactored success detection to handle archive CSV data and ensured the model leaderboard represents the full field of active agents.
  • New Features: Added a 'System Logs' tab with parsed telemetry and enhanced the 'Digital Bestiary' with milestone markers.
  • Code Quality: Resolved all ruff/mypy violations and removed unnecessary production dependencies.

PR created automatically by Jules for task 7778644714997318215 started by @BleakNarratives

- Refactor frontend for apocalypse theme with custom CSS and scanlines.
- Improve success detection logic in `is_event_success`.
- Add 'System Logs' tab for real-time terminal telemetry.
- Update leaderboard to include all active models, even those with zero successes.
- Rename 'Sectors Compromised' to 'Sectors Secured' for better clarity.
- Remove unused playwright dependency from project.

Co-authored-by: google-labs-jules[bot] <161369871+google-labs-jules[bot]@users.noreply.github.com>
@google-labs-jules
Copy link
Copy Markdown

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces several enhancements to the frontend, including a new "System Logs" tab, styling updates for successful cards in the digital bestiary, and improved logic for calculating apocalypse metrics to include models with zero successes. The review feedback highlights two important issues with pandas DataFrame handling: first, potential NaN values in model_display could incorrectly appear on the leaderboard, which can be resolved by applying .dropna(); second, using .get() on a pandas Series row returns NaN rather than the fallback default string for missing values, which should be handled using pd.notna() to avoid rendering **nan** in the UI.

Comment thread airtbench/frontend.py Outdated
Comment thread airtbench/frontend.py
Comment on lines +1004 to +1006
model = row.get("model_display", "UNKNOWN_AGENT")
challenge = row.get("challenge", "UNKNOWN_SECTOR")
is_success = row.get("is_success", False)
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

When iterating over a pandas DataFrame using iterrows(), each row is represented as a pd.Series. Calling row.get("model_display", "UNKNOWN_AGENT") will return NaN (a float) if the column exists but the value is null/missing, rather than falling back to the default string. This causes the UI to render **nan** instead of the fallback placeholder.

Using pd.notna() checks ensures that missing values are correctly replaced with the intended fallback strings.

        model_val = row.get("model_display")
        model = model_val if pd.notna(model_val) and model_val != "" else "UNKNOWN_AGENT"
        challenge_val = row.get("challenge")
        challenge = challenge_val if pd.notna(challenge_val) and challenge_val != "" else "UNKNOWN_SECTOR"
        is_success_val = row.get("is_success")
        is_success = bool(is_success_val) if pd.notna(is_success_val) else False

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: BleakNarratives <bleaknarratives@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant