edcadet10

edcadet10/wikipedia-ml-data-pipeline

An auditable Wikimedia-to-ML data pipeline with deterministic splits, Parquet, token shards, manifests, and validation.

6 good first / help-wanted issues · Python · last activity Aug 21, 2026

0 stars 0 forks 0 watchers Python Apache License 2.0
datasets etl machine-learning mlops nlp parquet reproducibility wikipedia
6 Open Issues Need Help Last updated: Aug 21, 2026

Open Issues Need Help

View All on GitHub
enhancement help wanted github-actions benchmark
edcadet10/wikipedia-ml-data-pipeline
0

An auditable Wikimedia-to-ML data pipeline with deterministic splits, Parquet, token shards, manifests, and validation.

Python
#datasets#etl#machine-learning#mlops#nlp#parquet#reproducibility#wikipedia
edcadet10/wikipedia-ml-data-pipeline
0

An auditable Wikimedia-to-ML data pipeline with deterministic splits, Parquet, token shards, manifests, and validation.

Python
#datasets#etl#machine-learning#mlops#nlp#parquet#reproducibility#wikipedia
help wanted extraction benchmark
edcadet10/wikipedia-ml-data-pipeline
0

An auditable Wikimedia-to-ML data pipeline with deterministic splits, Parquet, token shards, manifests, and validation.

Python
#datasets#etl#machine-learning#mlops#nlp#parquet#reproducibility#wikipedia
enhancement help wanted benchmark
edcadet10/wikipedia-ml-data-pipeline
0

An auditable Wikimedia-to-ML data pipeline with deterministic splits, Parquet, token shards, manifests, and validation.

Python
#datasets#etl#machine-learning#mlops#nlp#parquet#reproducibility#wikipedia
documentation help wanted needs-review
edcadet10/wikipedia-ml-data-pipeline
0

An auditable Wikimedia-to-ML data pipeline with deterministic splits, Parquet, token shards, manifests, and validation.

Python
#datasets#etl#machine-learning#mlops#nlp#parquet#reproducibility#wikipedia
help wanted needs-review extraction
edcadet10/wikipedia-ml-data-pipeline
0

An auditable Wikimedia-to-ML data pipeline with deterministic splits, Parquet, token shards, manifests, and validation.

Python
#datasets#etl#machine-learning#mlops#nlp#parquet#reproducibility#wikipedia