Co-authored-by: Antonio <antonio@zed.dev> Resurrected this from some assistant work I did in Spring of 2023. - [x] Resurrect streaming responses - [x] Use streaming responses to enable AI via Zed's servers by default (but preserve API key option for now) - [x] Simplify protobuf - [x] Proxy to OpenAI on zed.dev - [x] Proxy to Gemini on zed.dev - [x] Improve UX for switching between openAI and google models - We current disallow cycling when setting a custom model, but we need a better solution to keep OpenAI models available while testing the google ones - [x] Show remaining tokens correctly for Google models - [x] Remove semantic index - [x] Delete `ai` crate - [x] Cloud front so we can ban abuse - [x] Rate-limiting - [x] Fix panic when using inline assistant - [x] Double check the upgraded `AssistantSettings` are backwards-compatible - [x] Add hosted LLM interaction behind a `language-models` feature flag. Release Notes: - We are temporarily removing the semantic index in order to redesign it from scratch. --------- Co-authored-by: Antonio <antonio@zed.dev> Co-authored-by: Antonio Scandurra <me@as-cii.com> Co-authored-by: Thorsten <thorsten@zed.dev> Co-authored-by: Max <max@zed.dev>
30 lines
881 B
Rust
30 lines
881 B
Rust
use anyhow::Result;
|
|
use futures::{channel::mpsc, future::BoxFuture, stream::BoxStream, FutureExt, StreamExt};
|
|
use std::sync::Arc;
|
|
|
|
#[derive(Clone, Default)]
|
|
pub struct FakeCompletionProvider {
|
|
current_completion_tx: Arc<parking_lot::Mutex<Option<mpsc::UnboundedSender<String>>>>,
|
|
}
|
|
|
|
impl FakeCompletionProvider {
|
|
pub fn complete(&self) -> BoxFuture<'static, Result<BoxStream<'static, Result<String>>>> {
|
|
let (tx, rx) = mpsc::unbounded();
|
|
*self.current_completion_tx.lock() = Some(tx);
|
|
async move { Ok(rx.map(Ok).boxed()) }.boxed()
|
|
}
|
|
|
|
pub fn send_completion(&self, chunk: String) {
|
|
self.current_completion_tx
|
|
.lock()
|
|
.as_ref()
|
|
.unwrap()
|
|
.unbounded_send(chunk)
|
|
.unwrap();
|
|
}
|
|
|
|
pub fn finish_completion(&self) {
|
|
self.current_completion_tx.lock().take();
|
|
}
|
|
}
|