8378da6329
Fix for UTC warnings
2024-12-12 14:48:07 -08:00
f9af563df5
response.on_done() mechanism, closes #653
2024-12-01 15:47:23 -08:00
8a7b0c4f5d
response.usage() and await aresponse.usage(), closes #644
2024-11-19 21:25:37 -08:00
cfb10f4afd
Log input tokens, output tokens and token details ( #642 )
...
* Store input_tokens, output_tokens, token_details on Response, closes #610
* llm prompt -u/--usage option
* llm logs -u/--usage option
* Docs on tracking token usage in plugins
* OpenAI default plugin logs usage
2024-11-19 20:21:59 -08:00
4a059d722b
Log --async responses to DB, closes #641
...
Refs #507
2024-11-19 18:11:52 -08:00
0fec9746f4
text_or_raise() on sync Response too
...
Refs #632
2024-11-17 12:20:20 -08:00
cf172cc70a
response.text_or_raise() workaround
...
Closes https://github.com/simonw/llm/issues/632
2024-11-14 15:08:41 -08:00
3b6e73445c
Better __repr__ for Response and AsyncResponse
2024-11-14 14:42:40 -08:00
f90f29dec9
Removed accidental commit of Usage class
2024-11-14 14:29:05 -08:00
157b29ddeb
Test for basic async conversation, refs #632
2024-11-14 14:28:17 -08:00
ba75c674cb
llm.get_async_model(), llm.AsyncModel base class and OpenAI async models ( #613 )
...
- https://github.com/simonw/llm/issues/507#issuecomment-2458639308
* register_model is now async aware
Refs https://github.com/simonw/llm/issues/507#issuecomment-2458658134
* Refactor Chat and AsyncChat to use _Shared base class
Refs https://github.com/simonw/llm/issues/507#issuecomment-2458692338
* fixed function name
* Fix for infinite loop
* Applied Black
* Ran cog
* Applied Black
* Add Response.from_row() classmethod back again
It does not matter that this is a blocking call, since it is a classmethod
* Made mypy happy with llm/models.py
* mypy fixes for openai_models.py
I am unhappy with this, had to duplicate some code.
* First test for AsyncModel
* Still have not quite got this working
* Fix for not loading plugins during tests, refs #626
* audio/wav not audio/wave, refs #603
* Black and mypy and ruff all happy
* Refactor to avoid generics
* Removed obsolete response() method
* Support text = await async_mock_model.prompt("hello")
* Initial docs for llm.get_async_model() and await model.prompt()
Refs #507
* Initial async model plugin creation docs
* duration_ms ANY to pass test
* llm models --async option
Refs https://github.com/simonw/llm/pull/613#issuecomment-2474724406
* Removed obsolete TypeVars
* Expanded register_models() docs for async
* await model.prompt() now returns AsyncResponse
Refs https://github.com/simonw/llm/pull/613#issuecomment-2475157822
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-11-13 17:51:00 -08:00
5d1d723d4b
Special case treat audio/wave as audio/wav, closes #603
2024-11-07 17:13:54 -08:00
a7eedd1d2e
mypy fix, refs #601
Test / test (macos-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.9) (push) Has been cancelled
2024-11-01 14:21:01 -07:00
122265a3d2
Fix for chat continuation in llm chat, refs #601
2024-11-01 14:17:25 -07:00
be2953e6ab
Ruff and mypy fixes
2024-10-28 15:41:34 -07:00
570a3eccae
Python attachment documentation, plus fixed a mimetype detection bug
...
Refs #587
2024-10-28 15:41:34 -07:00
286cf9fcd9
attachments= keyword argument, tests pass again - refs #587
2024-10-28 15:41:34 -07:00
1126393ba1
Docs for writing models that accept attachments, refs #587
2024-10-28 15:41:34 -07:00
dff5b456fd
Got llm --continue to work with images, refs #587
2024-10-28 15:41:34 -07:00
c0fe719df6
Store prompt attachments in attachments and prompt_attachments tables
...
Refs https://github.com/simonw/llm/issues/587#issuecomment-2439791231
2024-10-28 15:41:34 -07:00
6df00f92ff
First working prototype of new attachments feature, refs #587
2024-10-28 15:41:34 -07:00
0a8fd77b26
Fix for mypy error, closes #491
...
This is why tests failed for #490
2024-05-13 13:00:03 -07:00
b9478e6a17
batch_size= argument to embed_multi(), refs #273
2023-09-13 16:24:04 -07:00
f54f2c659d
response.__str__ method, closes #268
2023-09-12 10:36:29 -07:00
52cec1304b
Binary embeddings ( #254 )
...
* Binary embeddings support, refs #253
* Write binary content to content_blob, with tests - refs #253
* supports_text and supports_binary embedding validation, refs #253
2023-09-11 18:58:44 -07:00
e49c816e18
Drop llm.EmbeddingModel.embedding_size property, closes #208
2023-09-02 08:45:17 -07:00
ec15707588
next(iter(...)), refs #200
2023-08-31 22:55:58 -07:00
817aff8bae
Embeddings now happen in batches, closes #200
2023-08-31 22:27:06 -07:00
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185
...
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
2023-08-27 22:24:10 -07:00
dff36f0edc
Change of policy: keys.json over-rides environment variables, closes #158
2023-08-20 23:27:21 -07:00
14a91efbad
Fixes for Pydantic 1, including matrix test - refs #169
...
Also refs #147
2023-08-19 20:59:30 -07:00
740a8e8344
Allow for use of Pydantic v1 as well as v2. ( #147 )
...
* Allow for use of Pydantic v1 as well as v2.
Use v1-style configuration. While this is officially
deprecated (https://docs.pydantic.dev/latest/usage/model_config/ ),
it is supported by v2. I would assume this support will remain
for a while, this will help ease the transition to v2
2023-08-19 20:50:59 -07:00
cb41409e2b
conversation_name should not have newlines, closes #110
2023-07-15 21:28:35 -07:00
19ba1a3099
Improvements to Response.fake() plus __repr__ for some classes
2023-07-11 15:14:52 -07:00
abfc9c69dc
Response.fake() method
...
I'm using this in https://github.com/simonw/llm-gpt4all/issues/4
2023-07-11 11:08:15 -07:00
18a89d8bb8
Removed obsolete OptionsError class
2023-07-11 10:53:04 -07:00
255f768707
Rename ._response_json to .response_json
2023-07-11 08:31:38 -07:00
2d3ebe7fe1
llm logs now uses new DB schema, refs #91
2023-07-11 07:21:22 -07:00
88d839fa85
Create conversations and responses tables and write to them, refs #91
2023-07-11 07:21:22 -07:00
21e6d54365
Remove unused imports
2023-07-11 00:09:35 -07:00
23eeb0f322
Remove experimental Model.chain() method, refs #90
2023-07-10 22:47:34 -07:00
b38b8314b9
Initial working implementation of conversations, refs #85
2023-07-10 22:37:45 -07:00
199f7e0767
Renamed iter_prompt() to execute() and updated tutorial
2023-07-10 07:59:12 -07:00
ae87f978bd
Moved iter_prompt from Response to Model, moved a lot of other stuff
...
- Moved a whole bunch of things from llm/cli.py into llm/__init__.py
- Switched plugin listings to use importlib.metadata to avoid deprecation warning
- iter_prompt() is now a method on Model, not on Response
2023-07-10 07:45:11 -07:00
902cf6010c
Fixed type hint on Prompt
2023-07-07 20:38:53 -07:00
04568115b8
Options base class is now llm.Options not Model.Options
2023-07-05 20:47:36 -07:00
4611bff412
iter_prompt() now takes prompt
2023-07-05 20:46:17 -07:00
b88906d459
Default __str__ method for models
2023-07-05 18:26:16 -07:00
6ef6b343a9
Improved how keys work, execute() now has default implementation
2023-07-05 18:25:57 -07:00
78c93b9e23
Model.execute() model now defaults to using self.Response
2023-07-05 16:57:10 -07:00
Simon Willison