Open Issues Need Help
View All on GitHubAI Summary: The task is to modify the `ClaudeLoader` in the `lightbench` project to correctly handle system messages when interacting with the Anthropic API. This involves parsing the input prompt to separate the system message from the user prompt and then passing them as separate arguments to the Anthropic API's `messages.create` function.
lightbench: a lightweight tool for benchmarking LLMs 🛠️
AI Summary: Add a 'Joule' result calculation to the lightbench project. This involves calculating energy consumption by multiplying the existing 'watt' and 'time' measurements. This requires modifying the existing code to include this calculation and potentially updating the output to display the Joule value.
lightbench: a lightweight tool for benchmarking LLMs 🛠️