d446b4d573
llm logs -x/--extract option ( #693 )
...
Test / test (macos-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.9) (push) Has been cancelled
* llm logs -x/--extract option
* Update docs/help.md for llm logs -x
* Added test for llm logs -x/--extract, refs #693
* llm logs -xr behaves same as llm logs -x
* -x/--extract in llm logging docs
---------
Co-authored-by: Simon Willison <swillison@gmail.com >
2025-01-10 15:55:26 -08:00
7136501500
llm models -q/--query option, closes #700
2025-01-10 15:55:26 -08:00
b2578727fc
o1 - refs #676
2024-12-22 14:06:47 -08:00
000e984def
--extract support for templates, closes #681
2024-12-19 07:16:48 -08:00
67d4a99645
llm prompt -x/--extract option, closes #681
2024-12-19 06:40:05 -08:00
6305b86026
gpt-4o-mini-audio-preview, closes #677
2024-12-17 20:28:57 -08:00
8898584ba6
New OpenAI audio models, closes #677
2024-12-17 11:14:42 -08:00
aa25ad1d54
o1-preview and o1-mini can stream now
...
Refs https://github.com/simonw/llm/issues/676#issuecomment-2549328154
2024-12-17 10:53:15 -08:00
571f4b2a4d
Fix for UTC warnings
...
Closes #672
2024-12-12 14:57:23 -08:00
491dd9b437
Removed accidental comment
2024-12-05 13:45:50 -08:00
b6be09aa28
Fix get_models() and get_async_models() duplicates bug
...
Closes #667 , refs #640
2024-12-05 13:44:07 -08:00
ac3d0089d0
Fix windows bug where llm doesn't run <<llm chat>> on Windows issue #495 ( #646 )
...
* Fix windows bug where llm doesn't run <<llm chat>> on Windows issue #495
* Applied Black
---------
Co-authored-by: Sukhbinder Singh <sukhbindersingh@gmail.com >
Co-authored-by: Simon Willison <swillison@gmail.com >
2024-12-01 15:57:24 -08:00
f9af563df5
response.on_done() mechanism, closes #653
2024-12-01 15:47:23 -08:00
c52cfee881
llm.get_models() and llm.get_async_models(), closes #640
2024-11-20 20:09:06 -08:00
8a7b0c4f5d
response.usage() and await aresponse.usage(), closes #644
2024-11-19 21:25:37 -08:00
cfb10f4afd
Log input tokens, output tokens and token details ( #642 )
...
* Store input_tokens, output_tokens, token_details on Response, closes #610
* llm prompt -u/--usage option
* llm logs -u/--usage option
* Docs on tracking token usage in plugins
* OpenAI default plugin logs usage
2024-11-19 20:21:59 -08:00
4a059d722b
Log --async responses to DB, closes #641
...
Refs #507
2024-11-19 18:11:52 -08:00
0fec9746f4
text_or_raise() on sync Response too
...
Refs #632
2024-11-17 12:20:20 -08:00
cf172cc70a
response.text_or_raise() workaround
...
Closes https://github.com/simonw/llm/issues/632
2024-11-14 15:08:41 -08:00
3b6e73445c
Better __repr__ for Response and AsyncResponse
2024-11-14 14:42:40 -08:00
f90f29dec9
Removed accidental commit of Usage class
2024-11-14 14:29:05 -08:00
157b29ddeb
Test for basic async conversation, refs #632
2024-11-14 14:28:17 -08:00
ba75c674cb
llm.get_async_model(), llm.AsyncModel base class and OpenAI async models ( #613 )
...
- https://github.com/simonw/llm/issues/507#issuecomment-2458639308
* register_model is now async aware
Refs https://github.com/simonw/llm/issues/507#issuecomment-2458658134
* Refactor Chat and AsyncChat to use _Shared base class
Refs https://github.com/simonw/llm/issues/507#issuecomment-2458692338
* fixed function name
* Fix for infinite loop
* Applied Black
* Ran cog
* Applied Black
* Add Response.from_row() classmethod back again
It does not matter that this is a blocking call, since it is a classmethod
* Made mypy happy with llm/models.py
* mypy fixes for openai_models.py
I am unhappy with this, had to duplicate some code.
* First test for AsyncModel
* Still have not quite got this working
* Fix for not loading plugins during tests, refs #626
* audio/wav not audio/wave, refs #603
* Black and mypy and ruff all happy
* Refactor to avoid generics
* Removed obsolete response() method
* Support text = await async_mock_model.prompt("hello")
* Initial docs for llm.get_async_model() and await model.prompt()
Refs #507
* Initial async model plugin creation docs
* duration_ms ANY to pass test
* llm models --async option
Refs https://github.com/simonw/llm/pull/613#issuecomment-2474724406
* Removed obsolete TypeVars
* Expanded register_models() docs for async
* await model.prompt() now returns AsyncResponse
Refs https://github.com/simonw/llm/pull/613#issuecomment-2475157822
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-11-13 17:51:00 -08:00
bc96e1c739
Ruff fix for #626
2024-11-13 06:37:31 -08:00
7520671176
audio/wav not audio/wave, refs #603
2024-11-12 21:43:07 -08:00
330e171e86
Fix for not loading plugins during tests, refs #626
2024-11-12 21:42:49 -08:00
dff53a9cae
Better --help for llm keys get, refs #623
2024-11-11 09:53:24 -08:00
561784df6e
llm keys get command, refs #623
2024-11-11 09:47:13 -08:00
5d1d723d4b
Special case treat audio/wave as audio/wav, closes #603
2024-11-07 17:13:54 -08:00
98d2c19876
Promote alternative model providers in llm --help
2024-11-06 06:38:53 -08:00
3352eb9f57
Serialize usage to JSON properly, closes #614
2024-11-06 03:27:25 -08:00
3b2e5263a3
Allow passing of can_stream in openai_models.py ( #600 )
...
* Allow passing of can_stream in openai_models.py
Fixes #599
* Only set can_stream: false if it is false
Refs https://github.com/simonw/llm/pull/600#issuecomment-2458825866
* Docs for can_stream: false
---------
Co-authored-by: Simon Willison <swillison@gmail.com >
2024-11-05 23:04:13 -08:00
7146fe82d1
Back to the deprecated Pydantic thing to get tests passing
...
Refs #612
2024-11-05 23:03:31 -08:00
12df1a3b2a
Show attachment types in llm models --options, closes #612
2024-11-05 22:49:26 -08:00
0cc4072bcd
Support attachments without prompts, closes #611
2024-11-05 21:27:18 -08:00
336ab1013d
gpt-4o-audio-preview audio input, refs #608
2024-11-05 21:08:52 -08:00
a7eedd1d2e
mypy fix, refs #601
Test / test (macos-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.9) (push) Has been cancelled
2024-11-01 14:21:01 -07:00
122265a3d2
Fix for chat continuation in llm chat, refs #601
2024-11-01 14:17:25 -07:00
389acdf52c
Track usage on OpenAI stream requests, closes #591
2024-10-28 17:40:40 -07:00
be2953e6ab
Ruff and mypy fixes
2024-10-28 15:41:34 -07:00
f0ed54abf1
Docs for CLI attachments, refs #587
2024-10-28 15:41:34 -07:00
570a3eccae
Python attachment documentation, plus fixed a mimetype detection bug
...
Refs #587
2024-10-28 15:41:34 -07:00
286cf9fcd9
attachments= keyword argument, tests pass again - refs #587
2024-10-28 15:41:34 -07:00
a9bc1c7329
llm logs --json for attachments, refs #587
2024-10-28 15:41:34 -07:00
2384fd52a0
Tighter log output for binary content
2024-10-28 15:41:34 -07:00
bb5b802d4f
llm logs markdown support for attachments, refs #587
2024-10-28 15:41:34 -07:00
1126393ba1
Docs for writing models that accept attachments, refs #587
2024-10-28 15:41:34 -07:00
a68af9c8e6
Don't redact non-data URLs for OpenAI models
...
Refs #587
2024-10-28 15:41:34 -07:00
cd722f653b
Redact base64 data from _prompt_json, refs #587
2024-10-28 15:41:34 -07:00
dff5b456fd
Got llm --continue to work with images, refs #587
2024-10-28 15:41:34 -07:00
Csaba Henk