Khanz9664

Khanz9664/TrustLens

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

12 stars 20 forks 12 watchers Python MIT License
ai-safety bias-detection calibration data-science evaluation-framework explainable-ai fairness fairness-ml machine-learning mlops model-evaluation model-monitoring model-reliability opensource python python-package trustworthy-ai
View on GitHub Website
31 Open Issues Need Help Last updated: Jul 3, 2026

Open Issues Need Help

View All on GitHub
[FEATURE]: Add Maximum Calibration Error (MCE) metric to the Calibration module about 3 hours ago
enhancement help wanted metrics intermediate waiting-for-contributor
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
[FEATURE] Add Support for Regression Models (Uncertainty & Error Analysis) 12 days ago
enhancement help wanted metrics api advanced testing ml claimed
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
[FEATURE]: Add native backend resolvers for LightGBM and CatBoost 19 days ago
enhancement help wanted feature ml claimed backend
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
[Enhancement]: Add a colorblind-safe theme to the TrustLens visualization system 21 days ago
good first issue visualization beginner hacktoberfest
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
[FEATURE]: Add native backend resolver for Hugging Face transformers 29 days ago
enhancement help wanted intermediate integration ml waiting-for-contributor backend high-priority NLP
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add TrustReport.to_dict() for JSON serialization 29 days ago
help wanted good first issue api
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
[Enhancement] Radar Comparison Visualization for TrustReport about 1 month ago
enhancement good first issue visualization beginner
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
[BUG]: XGBoost raw Booster models fail to map string labels in multi-class prediction (causes downstream crash) about 1 month ago
bug help wanted ml backend
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
[FEATURE]: First-Class MLOps Integration (W&B & MLflow) for TrustReport Logging about 1 month ago
enhancement help wanted ML Ops integration ml
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Improve docstring for analyze() with a full code example about 1 month ago
documentation good first issue reporting beginner hacktoberfest
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add progress bar to analyze() for better user experience about 1 month ago
enhancement help wanted beginner ux
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add `__all__` to remaining modules about 1 month ago
enhancement good first issue beginner hacktoberfest
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add clearer error message for invalid input shapes about 1 month ago
enhancement good first issue beginner ux
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
[RFC] : Prediction Resolver Core Refactor about 2 months ago
enhancement good first issue architecture backend high-priority
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
# [FEATURE] Add TrustReport comparison for model drift & reliability deltas about 2 months ago
enhancement help wanted api reporting intermediate testing feature ML Ops waiting-for-contributor
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add Fairness Visualization (Subgroup Comparison Plots) 2 months ago
enhancement good first issue visualization
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add bias analysis demo with subgroup diagnostics 2 months ago
good first issue ux bias example
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add SECURITY.md file 2 months ago
documentation good first issue reporting beginner hacktoberfest
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add Equalized Odds for subgroup fairness analysis 2 months ago
help wanted intermediate feature ML Ops fairness ml
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add Python 3.13 to CI matrix 2 months ago
enhancement good first issue beginner hacktoberfest
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add `n_samples` per bin to `reliability_curve()` output 2 months ago
good first issue metrics beginner hacktoberfest
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Fix visualization crash for single-class edge case 2 months ago
bug help wanted good first issue beginner
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Show progress messages in analyze() 2 months ago
good first issue beginner ux hacktoberfest
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add CLI support: trustlens analyze 3 months ago
help wanted intermediate ux feature ML Ops cli
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add Weights & Biases (W&B) integration for TrustReport logging 3 months ago
help wanted intermediate feature ML Ops integration
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add MLflow integration for logging TrustReport 3 months ago
help wanted intermediate feature ML Ops
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add shared pytest fixtures via conftest.py 3 months ago
enhancement help wanted intermediate testing
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add per-class accuracy metric to failure analysis 3 months ago
enhancement help wanted good first issue
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add confidence-correctness Spearman correlation to failure analysis 3 months ago
help wanted good first issue
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add HTML report export — shareable model analysis dashboard 3 months ago
enhancement help wanted reporting
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai
Add Maximum Calibration Error (MCE) — worst-case calibration metric 3 months ago
help wanted good first issue metrics
Khanz9664/TrustLens
12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python
#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai