More fixes to the semantic index's chunking (#11376)

This fixes a tricky intermittent issue I was seeing, where failed to
chunk certain files correctly because of the way we reuse Tree-sitter
`Parser` instances across parses.

I've also accounted for leading comments in chunk boundaries, so that
items are grouped with their leading comments whenever possible when
chunking.

Finally, we've changed the `debug project index` action so that it opens
a simple debug view in a pane, instead of printing paths to the console.
This lets you click into a path and see how it was chunked.

Release Notes:

- N/A

---------

Co-authored-by: Marshall <marshall@zed.dev>

This commit is contained in:

Max Brunsfeld

2024-05-03 19:00:18 -07:00

committed by

GitHub

co-authored by

Marshall

parent 335c307b93

commit 6964302d89

11 changed files with 532 additions and 171 deletions

Cargo.lock

Generated

View File

@@ -8713,9 +8713,12 @@ dependencies = [
  "sha2 0.10.7",
  "smol",
  "tempfile",
  "theme",
  "tree-sitter",
  "ui",
  "unindent",
  "util",
  "workspace",
  "worktree",
 ]