oak-team/oak-gpui
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
22,609 Commits 1 Branch 0 Tags
d55f0259060a4461cf04ef60c04701285763bb28
Commit Graph
6 Commits
Author SHA1 Message Date
Marshall BowersAntonio ScandurraAntonio
 		d55f025906 collab: Track cache writes/reads in LLM usage (#18834) 
This PR extends the LLM usage tracking to support tracking usage for
cache writes and reads for Anthropic models.

Release Notes:

- N/A

---------

Co-authored-by: Antonio Scandurra <me@as-cii.com>
Co-authored-by: Antonio <antonio@zed.dev>
 2024-10-07 17:32:49 -04:00
Marshall Bowers a9441879c3 collab: Fix writing LLM rate limit events to Clickhouse (#16367) 
This PR fixes the writing of LLM rate limit events to Clickhouse.

We had a table in the table name: `llm_rate_limits` instead of
`llm_rate_limit_events`.

I also extracted a helper function to write to Clickhouse so we can use
it anywhere we need to.

Release Notes:

- N/A
 2024-08-16 14:03:34 -04:00
Max BrunsfeldandMarshall dbcd06642c Track lifetime spending for each user and model (#16137) 
Release Notes:

- N/A

Co-authored-by: Marshall <marshall@zed.dev>
 2024-08-12 20:15:26 -04:00
Max BrunsfeldandMarshall a3c79218c4 Report telemetry events for rate limit errors (#16130) 
clickhouse telemetry schema:

```
CREATE TABLE default.llm_rate_limit_events
(
    `time` DateTime64(3),
    `user_id` Int32,
    `is_staff` Bool,
    `plan` LowCardinality(String),
    `model` String,
    `provider` LowCardinality(String),
    `usage_measure` LowCardinality(String),
    `requests_this_minute` UInt64,
    `tokens_this_minute` UInt64,
    `tokens_this_day` UInt64,
    `max_requests_per_minute` UInt64,
    `max_tokens_per_minute` UInt64,
    `max_tokens_per_day` UInt64,
    `users_in_recent_minutes` UInt64,
    `users_in_recent_days` UInt64
)
ORDER BY tuple()
```

Release Notes:

- N/A

Co-authored-by: Marshall <marshall@zed.dev>
 2024-08-12 16:31:11 -04:00
Max BrunsfeldandMarshall 33e120d964 Capture telemetry data on per-user monthly LLM spending (#16050) 
Release Notes:

- N/A

---------

Co-authored-by: Marshall <marshall@zed.dev>
 2024-08-09 16:38:37 -07:00
Max BrunsfeldandMarshall 8688b2ad19 Add telemetry for LLM usage (#16049) 
Release Notes:

- N/A

Co-authored-by: Marshall <marshall@zed.dev>
 2024-08-09 18:15:57 -04:00