[Eval Results] llama-3.2-1b-instruct on smalleval/mmlu-nano:mmlu_high_school_physics.jsonl - 17.9% Accuracy

[sauravpanda]

Evaluation Results

Metadata

• Dataset: smalleval/mmlu-nano:mmlu_high_school_physics.jsonl
• Model: llama-3.2-1b-instruct
• Evaluation Type: evaluation

Performance Metrics

• Accuracy: 17.9%
• Total Questions: 151
• Average Latency: 0.00ms
• Tokens/Second: 0.00
• Memory Usage: 883.29MB

System Information

• Browser: chrome 131
• OS: MacIntel
• CPU: 10 cores
• RAM: 8GB
• GPU: Not Available
• Timestamp: 2025-01-21 05:36:25

Evaluation Results Jan 21 2025 (2).json