apache

apache/datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine

52 good first / help-wanted issues · Rust · last activity Jul 1, 2026

2.1K stars 292 forks 2.1K watchers Rust Apache License 2.0
arrow big-data dataframe distributed olap python query-engine rust sql
View on GitHub Website
52 Open Issues Need Help Last updated: Jul 1, 2026

Open Issues Need Help

View All on GitHub
[EPIC] Reduce complexity and duplication hotspots in Ballista 3 days ago
enhancement help wanted tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
TUI: unify App::on_key and App::on_key_sync so key handling lives in one place 6 days ago
enhancement help wanted TUI tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Extract shared execute/handoff logic from the three shuffle writer execs 9 days ago
enhancement help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
TUI: collapse repeated sort-order blocks in JobsData::sort_jobs and share table scrolling helpers 15 days ago
enhancement good first issue help wanted TUI tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
AQE: resolve_stage and rollback_*_stage drop the stage from the graph when the conversion fails 17 days ago
bug help wanted rust correctness tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Share the binding driver between bind_task_bias and bind_task_round_robin 18 days ago
enhancement help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Deduplicate the TPC-H table schema across scheduler tests and benchmarks 20 days ago
enhancement good first issue help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Deduplicate execute_query_pull and execute_query_push in DistributedQueryExec 20 days ago
enhancement help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
[EPIC] Share execution graph logic between StaticExecutionGraph and AdaptiveExecutionGraph 20 days ago
enhancement help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
BallistaClient: share retry logic between execute_do_get and execute_do_action_with_header, and don't panic when io_retries_times is 0 20 days ago
enhancement good first issue help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
AQE: split SelectJoinRule::optimize into per-action methods and flatten its nesting 20 days ago
enhancement help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Break start_executor_process_inner into startup phases 20 days ago
enhancement help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Split QueryStageScheduler::on_receive into per-event handlers 20 days ago
enhancement help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Executor never honours scheduler_connect_timeout_seconds and retries the scheduler connection forever 20 days ago
bug help wanted rust tech debt
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Run cargo machete in CI to catch unused dependencies 2 months ago
enhancement good first issue
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
arrow-ipc-optimizations in ballista-executor does not forward to ballista-core 2 months ago
good first issue
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Use OpenAPI to document public REST interfaces 3 months ago
documentation enhancement good first issue help wanted user experience
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
use `insta::assert_snapshot!` for all plan assertions 3 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Web TUI has not been mentioned anywhere 3 months ago
documentation enhancement help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
[EPIC] Adaptive Query Execution (AQE) 4 months ago
help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Improve job failure handling 4 months ago
bug help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Add TPC-DS workflow 4 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
`ExecutorMetatada` too verbose 5 months ago
bug help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
REST API stage plan is too busy 5 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Static job planner to respect `datafusion....hash_join_single_partition_threshold` for broadcast decision 5 months ago
enhancement help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
feat: make it user configurable to display plans as tree renderer 5 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
REST API to provide job configuration information 5 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
REST API to expose job runtime metrics 5 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
REST API does not show running jobs 6 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Improve integration tests to test push scheduler mode as well 6 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
if the job fail rest api will panic with: `attempt to subtract with overflow` 6 months ago
bug good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
make `/api/executor/<id>` return number of cpus & update tui to show it 6 months ago
good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
How to check the execution time of stages? 6 months ago
bug good first issue help wanted user experience web user interface
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Update documentation with Ballista TUI details 7 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Add interactive TUI (Text User Interface) for cluster monitoring 8 months ago
good first issue
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
bug: Disable `DataFrame.cache()` for ballista 9 months ago
bug enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Add Spark compatibility mode using datafusion-spark expressions 9 months ago
help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Improve Jupyter notebook support with SQL magic commands and examples 9 months ago
good first issue help wanted python
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Provide support for SSL/TSL connections 9 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Update to DataFusion v.52 10 months ago
enhancement good first issue help wanted datafusion
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Enable benchmark data validation for distributed execution 10 months ago
enhancement good first issue
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Github Actions covering python submodule improvements 10 months ago
enhancement good first issue help wanted python development-process
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Consider adding `BatchCoalescer` to `ShuffleReader` 10 months ago
enhancement help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Document ballista extensions with examples 10 months ago
documentation good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Fail the build if public method is missing rustdoc 10 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Remove query type `sql` from ballista protocol 10 months ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
update rust edition to 2024 10 months ago
enhancement good first issue
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Make gRPC timeouts user-configurable about 1 year ago
enhancement good first issue
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Expose Logical and Physical plan details in the REST API about 1 year ago
enhancement good first issue help wanted user experience web user interface
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
job data cleanup does not work if `pull-staged` strategy selected about 1 year ago
bug good first issue
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Improve `EXPLAN` command support about 1 year ago
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql
Replace configure_me with maintained alternative over 1 year ago

AI Summary: Replace the deprecated and unmaintained `configure_me` dependency in the Apache Ballista project with a modern alternative such as `clap`, resolving compatibility issues and enabling an upgrade to Rust edition 2024. This involves identifying all usages of `configure_me`, refactoring the code to use the chosen replacement, and thoroughly testing the changes to ensure functionality.

Complexity: 4/5
enhancement good first issue help wanted
apache/datafusion-ballista
2.1K

Apache DataFusion Ballista Distributed Query Engine

Rust
#arrow#big-data#dataframe#distributed#olap#python#query-engine#rust#sql