78a0e9bd44
llm --files --encoding option and latin-1 fallback, closes #225
2023-09-04 12:28:31 -07:00
3bf781fba2
Duplicate content is only embedded once, closes #217
2023-09-03 17:39:11 -07:00
0eda99e91c
Default embedding model finishing touches, closes #222
2023-09-03 17:21:47 -07:00
b9c19a5666
Tests for multiple --files pairs
2023-09-03 16:40:00 -07:00
6f62b7d613
Tests for llm embed-multi --files, refs #215
2023-09-03 16:40:00 -07:00
0da1ed7d98
--remove-default for llm embed-models default, refs #222
2023-09-03 16:40:00 -07:00
c8c0f80441
--prefix for llm embed-multi, refs #215
2023-09-03 16:40:00 -07:00
70a3d4bdc4
Test for llm embed-multi against SQLite, refs #215
2023-09-03 16:40:00 -07:00
5e686fe8b3
Tests for CSV/TSV/JSON/NL, refs #215
2023-09-03 16:40:00 -07:00
213e0b0c75
embed-db delete-collection command and .delete() method, closes #219
2023-09-03 12:55:48 -07:00
a5d6b580ba
Store content_hash in embeddings table, refs #217
...
Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9
2023-09-03 10:50:51 -07:00
26332045dd
llm embed --metadata option, closes #209
2023-09-03 07:43:23 -07:00
73a9043108
Store updated timestamp on embeddings, closes #211
2023-09-02 20:40:33 -07:00
6b042a264a
Fixed -i and -i - modes for llm embed command
2023-09-01 20:24:58 -07:00
4be89facb5
Fixed and finished llm similar command, closes #190
2023-09-01 19:01:16 -07:00
3ee92152e8
Error conditions for 'llm similar', refs #190
2023-09-01 18:31:59 -07:00
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185
...
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
2023-08-27 22:24:10 -07:00
Simon Willison