Prove what your model was trained on. Open-source data factory for LLM training corpora: provenance gating, dedup, PII redaction, contamination checks — sealed with a reproducible build manifest. Emits the EU AI Act Article 53(1)(d) training-content summary.

2 stars 1 forks 2 watchers Python Apache License 2.0
ai-compliance ai-governance apache-2-0 attestation corpus data-engineering data-provenance data-quality dataset deduplication eu-ai-act indic-nlp llm llmops minhash mlops pii-redaction reproducibility training-data
3 Open Issues Need Help Last updated: Aug 25, 2026

Open Issues Need Help

View All on GitHub
good first issue

Prove what your model was trained on. Open-source data factory for LLM training corpora: provenance gating, dedup, PII redaction, contamination checks — sealed with a reproducible build manifest. Emits the EU AI Act Article 53(1)(d) training-content summary.

Python
#ai-compliance#ai-governance#apache-2-0#attestation#corpus#data-engineering#data-provenance#data-quality#dataset#deduplication#eu-ai-act#indic-nlp#llm#llmops#minhash#mlops#pii-redaction#reproducibility#training-data
good first issue

Prove what your model was trained on. Open-source data factory for LLM training corpora: provenance gating, dedup, PII redaction, contamination checks — sealed with a reproducible build manifest. Emits the EU AI Act Article 53(1)(d) training-content summary.

Python
#ai-compliance#ai-governance#apache-2-0#attestation#corpus#data-engineering#data-provenance#data-quality#dataset#deduplication#eu-ai-act#indic-nlp#llm#llmops#minhash#mlops#pii-redaction#reproducibility#training-data
good first issue

Prove what your model was trained on. Open-source data factory for LLM training corpora: provenance gating, dedup, PII redaction, contamination checks — sealed with a reproducible build manifest. Emits the EU AI Act Article 53(1)(d) training-content summary.

Python
#ai-compliance#ai-governance#apache-2-0#attestation#corpus#data-engineering#data-provenance#data-quality#dataset#deduplication#eu-ai-act#indic-nlp#llm#llmops#minhash#mlops#pii-redaction#reproducibility#training-data