Khanz9664

Khanz9664/TrustLens

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

31 good first / help-wanted issues · Python · last activity Jul 3, 2026

12 stars 20 forks 12 watchers Python MIT License

ai-safety bias-detection calibration data-science evaluation-framework explainable-ai fairness fairness-ml machine-learning mlops model-evaluation model-monitoring model-reliability opensource python python-package trustworthy-ai

View on GitHub Website

31 Open Issues Need Help Last updated: Jul 3, 2026

Open Issues Need Help

View All on GitHub

[FEATURE]: Add native backend resolver for Hugging Face transformers 4 months ago

enhancement help wanted intermediate integration ml waiting-for-contributor backend high-priority NLP

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

[FEATURE]: Add Maximum Calibration Error (MCE) metric to the Calibration module 4 months ago

enhancement help wanted metrics intermediate waiting-for-contributor claimed

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

[FEATURE] Add Support for Regression Models (Uncertainty & Error Analysis) 4 months ago

enhancement help wanted metrics api advanced testing ml claimed

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

[FEATURE]: Add native backend resolvers for LightGBM and CatBoost 4 months ago

enhancement help wanted feature ml claimed backend

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

[Enhancement]: Add a colorblind-safe theme to the TrustLens visualization system 4 months ago

good first issue visualization beginner hacktoberfest

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add TrustReport.to_dict() for JSON serialization 5 months ago

help wanted good first issue api

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

[Enhancement] Radar Comparison Visualization for TrustReport 5 months ago

enhancement good first issue visualization beginner

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

[BUG]: XGBoost raw Booster models fail to map string labels in multi-class prediction (causes downstream crash) 5 months ago

bug help wanted ml backend

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

[FEATURE]: First-Class MLOps Integration (W&B & MLflow) for TrustReport Logging 5 months ago

enhancement help wanted ML Ops integration ml

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Improve docstring for analyze() with a full code example 5 months ago

documentation good first issue reporting beginner hacktoberfest

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add progress bar to analyze() for better user experience 5 months ago

enhancement help wanted beginner ux

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add `__all__` to remaining modules 5 months ago

enhancement good first issue beginner hacktoberfest

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add clearer error message for invalid input shapes 5 months ago

enhancement good first issue beginner ux

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

[RFC] : Prediction Resolver Core Refactor 6 months ago

enhancement good first issue architecture backend high-priority

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

# [FEATURE] Add TrustReport comparison for model drift & reliability deltas 6 months ago

enhancement help wanted api reporting intermediate testing feature ML Ops waiting-for-contributor

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add Fairness Visualization (Subgroup Comparison Plots) 6 months ago

enhancement good first issue visualization

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add bias analysis demo with subgroup diagnostics 6 months ago

good first issue ux bias example

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add SECURITY.md file 6 months ago

documentation good first issue reporting beginner hacktoberfest

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add Equalized Odds for subgroup fairness analysis 6 months ago

help wanted intermediate feature ML Ops fairness ml

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add Python 3.13 to CI matrix 6 months ago

enhancement good first issue beginner hacktoberfest

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add `n_samples` per bin to `reliability_curve()` output 6 months ago

good first issue metrics beginner hacktoberfest

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Fix visualization crash for single-class edge case 6 months ago

bug help wanted good first issue beginner

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Show progress messages in analyze() 6 months ago

good first issue beginner ux hacktoberfest

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add CLI support: trustlens analyze 6 months ago

help wanted intermediate ux feature ML Ops cli

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add Weights & Biases (W&B) integration for TrustReport logging 6 months ago

help wanted intermediate feature ML Ops integration

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add MLflow integration for logging TrustReport 6 months ago

help wanted intermediate feature ML Ops

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add shared pytest fixtures via conftest.py 6 months ago

enhancement help wanted intermediate testing

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add per-class accuracy metric to failure analysis 6 months ago

enhancement help wanted good first issue

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add confidence-correctness Spearman correlation to failure analysis 6 months ago

help wanted good first issue

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add HTML report export — shareable model analysis dashboard 6 months ago

enhancement help wanted reporting

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai

Add Maximum Calibration Error (MCE) — worst-case calibration metric 6 months ago

help wanted good first issue metrics

Khanz9664/TrustLens

12

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

Python

#ai-safety#bias-detection#calibration#data-science#evaluation-framework#explainable-ai#fairness#fairness-ml#machine-learning#mlops#model-evaluation#model-monitoring#model-reliability#opensource#python#python-package#trustworthy-ai