5495112d9f
Initial tests for llm chat, refs #231
2023-09-04 23:36:25 -07:00
969a5d3364
Initial prototype of llm chat, refs #231
2023-09-04 23:36:25 -07:00
78a0e9bd44
llm --files --encoding option and latin-1 fallback, closes #225
2023-09-04 12:28:31 -07:00
a54743f228
Fix to get embedding set_alias to work
...
Refs:
- https://github.com/simonw/llm-sentence-transformers/issues/4
- https://github.com/simonw/llm/issues/192
2023-09-03 18:15:45 -07:00
2e90a30c4f
Add embedding model aliases to llm aliases, refs #192
2023-09-03 17:55:56 -07:00
3bf781fba2
Duplicate content is only embedded once, closes #217
2023-09-03 17:39:11 -07:00
0eda99e91c
Default embedding model finishing touches, closes #222
2023-09-03 17:21:47 -07:00
0da1ed7d98
--remove-default for llm embed-models default, refs #222
2023-09-03 16:40:00 -07:00
c8c0f80441
--prefix for llm embed-multi, refs #215
2023-09-03 16:40:00 -07:00
2440eb4f48
Help tweak and ran cog
2023-09-03 16:40:00 -07:00
3d379fbddc
In progress llm embed-multi, refs #215
2023-09-03 16:40:00 -07:00
156bed7c65
Populate content_hash with embed_multi, refs #217
2023-09-03 14:43:29 -07:00
53fc9cbab7
Fixed hookspec docstrings
2023-09-03 14:04:23 -07:00
213e0b0c75
embed-db delete-collection command and .delete() method, closes #219
2023-09-03 12:55:48 -07:00
87af2ddda9
De-register functions after migration, refs #217
...
Also refs https://github.com/simonw/sqlite-utils/issues/589
2023-09-03 12:33:06 -07:00
573659c84d
Remove obsolete debugging code
2023-09-03 10:58:46 -07:00
a5d6b580ba
Store content_hash in embeddings table, refs #217
...
Uses new migrations feature from https://github.com/simonw/sqlite-migrate/issues/9
2023-09-03 10:50:51 -07:00
26332045dd
llm embed --metadata option, closes #209
2023-09-03 07:43:23 -07:00
73a9043108
Store updated timestamp on embeddings, closes #211
2023-09-02 20:40:33 -07:00
51488c579b
Collection now defaults to in-memory DB, closes #213
2023-09-02 15:43:20 -07:00
e49c816e18
Drop llm.EmbeddingModel.embedding_size property, closes #208
2023-09-02 08:45:17 -07:00
3d56d6cc24
Collection design tweaks + llm embed/similar now use it, closes #204
2023-09-02 08:30:56 -07:00
2f178a9e9b
Corrected type annotations for embed_multi, refs #202
2023-09-01 20:27:35 -07:00
6b042a264a
Fixed -i and -i - modes for llm embed command
2023-09-01 20:24:58 -07:00
3b2d5bf7f9
embed_multi and embed_multi_with_metadata, closes #202
2023-09-01 20:15:28 -07:00
4be89facb5
Fixed and finished llm similar command, closes #190
2023-09-01 19:01:16 -07:00
3ee92152e8
Error conditions for 'llm similar', refs #190
2023-09-01 18:31:59 -07:00
de6d257dde
collection.similar now returns List[Entry], closes #203
2023-09-01 18:06:56 -07:00
212cd617f3
Initial Python embeddings API docs, refs #191
2023-09-01 17:25:45 -07:00
0ec516559a
Collection.similar methods, refs #191
2023-09-01 16:26:58 -07:00
7a4429f100
Fix mypy errors
...
Refs https://github.com/simonw/llm/issues/191#issuecomment-1703266224
2023-09-01 13:14:59 -07:00
6f761702dc
Initial Collection class plus test, refs #191
2023-09-01 13:04:05 -07:00
2463b28bf0
Fix for llm similar tils2 -c python, refs #190
2023-08-31 23:12:05 -07:00
5e82929eca
First working version of llm similar, refs #190
2023-08-31 22:57:00 -07:00
ec15707588
next(iter(...)), refs #200
2023-08-31 22:55:58 -07:00
817aff8bae
Embeddings now happen in batches, closes #200
2023-08-31 22:27:06 -07:00
8099384391
Add foreign key from embeddings to collections, refs #185
2023-08-31 22:16:25 -07:00
b30f6894f7
Fixed bug if LLM directory does not exist, closes #193
2023-08-31 20:26:05 -07:00
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185
...
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
2023-08-27 22:24:10 -07:00
dff36f0edc
Change of policy: keys.json over-rides environment variables, closes #158
2023-08-20 23:27:21 -07:00
e959026051
llm keys command, closes #174
2023-08-20 23:11:47 -07:00
85e18389b5
Removed rogue pdb.set_trace() I left in
...
Mistake made in 0eeb8393ca
2023-08-20 23:04:52 -07:00
c8e9565f47
Combine piped and argument prompts, closes #153
2023-08-20 22:57:29 -07:00
091984cca2
Refactor to use llm.set_alias() / remove_alias(), closes #154
2023-08-19 22:11:19 -07:00
c290b44d45
llm.remove_alias() function, refs #154
2023-08-19 22:06:51 -07:00
8cdcf1e689
llm.set_alias() function, refs #154
2023-08-19 22:01:29 -07:00
0cd9333054
llm aliases defaults to llm aliases list, refs #154
...
Refs #167
2023-08-19 21:48:20 -07:00
adb900be1a
Restore extra=forbid for Template, refs #169
2023-08-19 21:42:32 -07:00
5bf0f4165f
Removed incomplete model_config feature, refs #169
2023-08-19 21:38:09 -07:00
a105d98b58
Ignore mypy error, refs #169
2023-08-19 21:35:35 -07:00
Simon Willison