Open Issues Need Help
View All on GitHub Add JudgeLM as a way to evaluate and compare historical test runs about 2 months ago
enhancement help wanted
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
Evaluation Dataset Generation 3 months ago
enhancement help wanted
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
Make Own Implementation of Dbias and Detoxify 3 months ago
help wanted
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
Support popular benchmarks 3 months ago
enhancement help wanted
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
DeepEval for Typescript 4 months ago
documentation enhancement help wanted
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
enhancement help wanted
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
AsyncConfig import problem 8 months ago
help wanted
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
Support Open Router 12 months ago
help wanted
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
enhancement good first issue help wanted hacktoberfest
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
bug good first issue help wanted hacktoberfest
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
enhancement good first issue help wanted hacktoberfest
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
bug help wanted hacktoberfest
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python
feat: Add per-task timeouts to `observed_callback` in execute.py about 1 year ago
enhancement good first issue help wanted hacktoberfest
confident-ai/deepeval confident-ai/deepeval The LLM Evaluation Framework
Open project →
16.6K
The LLM Evaluation Framework
Python
#evaluation-framework#evaluation-metrics#llm-evaluation#llm-evaluation-framework#llm-evaluation-metrics#python