Open Issues Need Help
View All on GitHub Streaming for query pipelines 3 months ago
AI Summary: Implement streaming capabilities for Swiftide's query pipelines, allowing for a more responsive user experience. This involves modifying the `Answer` trait to support streaming responses, adding an `on_stream` hook to the query pipeline, and updating the `Simple` answer step to utilize streaming capabilities from the underlying LLM client. Consideration should be given to maintaining backward compatibility and handling cases where streaming is not supported.
Complexity:
4/5
enhancement help wanted
Fast, streaming indexing, query, and agentic LLM applications in Rust
Rust
#agents#ai#data#genai#indexing#llm#llmops#ml#rag#retrieval-augmented-generation#rust