Skip to content

Fix NaN scores for short documents#92

Draft
Mirochill wants to merge 1 commit into
freedmand:mainfrom
Mirochill:fix-35-short-document-scores
Draft

Fix NaN scores for short documents#92
Mirochill wants to merge 1 commit into
freedmand:mainfrom
Mirochill:fix-35-short-document-scores

Conversation

@Mirochill

Copy link
Copy Markdown

Summary

  • Ensure non-empty documents shorter than the default rewind still get an embedding window.
  • Drop empty embedding windows before indexing and skip documents with no embeddings during queries.
  • Avoid averaging empty result lists when sorting or displaying search results.

Fixes #35.

Validation

  • git diff --check HEAD~1..HEAD

Tests not run locally.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

All result scores are "nan"

1 participant