Open Issues Need Help
View All on GitHubAI Summary: This issue proposes that Orion, a performance testing tool, should implement exit codes similar to kube-burner. These exit codes would indicate the success or failure of a benchmark execution, with specific codes for generic errors and performance regressions.
AI Summary: The current windowing mechanism in Orion, which uses Hunter for changepoint detection, is incorrectly identifying anomalies as changepoints due to insufficient data samples. The proposed solution involves verifying detected changepoints by examining additional samples before and after the identified point, and avoiding conclusions when insufficient data is available.
AI Summary: Implement a new `orion version` command-line option that displays the current version of the Orion tool, similar to existing commands in kube-burner and kube-burner-ocp. This should leverage existing tagged releases.