mirrors / simonw--llm

文件历史

583 提交 56 分支 64 Git 标签
0.19a0
提交图

290 次代码提交

作者 SHA1 备注 提交日期
Simon Willison cfb10f4afd Log input tokens, output tokens and token details (#642) 
* Store input_tokens, output_tokens, token_details on Response, closes #610
* llm prompt -u/--usage option
* llm logs -u/--usage option
* Docs on tracking token usage in plugins
* OpenAI default plugin logs usage
 2024-11-19 20:21:59 -08:00
Simon Willison 4a059d722b Log --async responses to DB, closes #641 
Refs #507
 2024-11-19 18:11:52 -08:00
Simon Willison 0fec9746f4 text_or_raise() on sync Response too 
Refs #632
 2024-11-17 12:20:20 -08:00
Simon Willison cf172cc70a response.text_or_raise() workaround 
Closes https://github.com/simonw/llm/issues/632
 2024-11-14 15:08:41 -08:00
Simon Willison 3b6e73445c Better __repr__ for Response and AsyncResponse 2024-11-14 14:42:40 -08:00
Simon Willison f90f29dec9 Removed accidental commit of Usage class 2024-11-14 14:29:05 -08:00
Simon Willison 157b29ddeb Test for basic async conversation, refs #632 2024-11-14 14:28:17 -08:00
Simon Willison ba75c674cb llm.get_async_model(), llm.AsyncModel base class and OpenAI async models (#613) 
- https://github.com/simonw/llm/issues/507#issuecomment-2458639308

* register_model is now async aware

Refs https://github.com/simonw/llm/issues/507#issuecomment-2458658134

* Refactor Chat and AsyncChat to use _Shared base class

Refs https://github.com/simonw/llm/issues/507#issuecomment-2458692338

* fixed function name

* Fix for infinite loop

* Applied Black

* Ran cog

* Applied Black

* Add Response.from_row() classmethod back again

It does not matter that this is a blocking call, since it is a classmethod

* Made mypy happy with llm/models.py

* mypy fixes for openai_models.py

I am unhappy with this, had to duplicate some code.

* First test for AsyncModel

* Still have not quite got this working

* Fix for not loading plugins during tests, refs #626

* audio/wav not audio/wave, refs #603

* Black and mypy and ruff all happy

* Refactor to avoid generics

* Removed obsolete response() method

* Support text = await async_mock_model.prompt("hello")

* Initial docs for llm.get_async_model() and await model.prompt()

Refs #507

* Initial async model plugin creation docs

* duration_ms ANY to pass test

* llm models --async option

Refs https://github.com/simonw/llm/pull/613#issuecomment-2474724406

* Removed obsolete TypeVars

* Expanded register_models() docs for async

* await model.prompt() now returns AsyncResponse

Refs https://github.com/simonw/llm/pull/613#issuecomment-2475157822

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2024-11-13 17:51:00 -08:00
Simon Willison bc96e1c739 Ruff fix for #626 2024-11-13 06:37:31 -08:00
Simon Willison 7520671176 audio/wav not audio/wave, refs #603 2024-11-12 21:43:07 -08:00
Simon Willison 330e171e86 Fix for not loading plugins during tests, refs #626 2024-11-12 21:42:49 -08:00
Simon Willison dff53a9cae Better --help for llm keys get, refs #623 2024-11-11 09:53:24 -08:00
Simon Willison 561784df6e llm keys get command, refs #623 2024-11-11 09:47:13 -08:00
Simon Willison 5d1d723d4b Special case treat audio/wave as audio/wav, closes #603 2024-11-07 17:13:54 -08:00
Simon Willison 98d2c19876 Promote alternative model providers in llm --help 2024-11-06 06:38:53 -08:00
Simon Willison 3352eb9f57 Serialize usage to JSON properly, closes #614 2024-11-06 03:27:25 -08:00
Chris Mungall 3b2e5263a3 Allow passing of can_stream in openai_models.py (#600) 
* Allow passing of can_stream in openai_models.py

Fixes #599 

* Only set can_stream: false if it is false

Refs https://github.com/simonw/llm/pull/600#issuecomment-2458825866

* Docs for can_stream: false

---------

Co-authored-by: Simon Willison <swillison@gmail.com>
 2024-11-05 23:04:13 -08:00
Simon Willison 7146fe82d1 Back to the deprecated Pydantic thing to get tests passing 
Refs #612
 2024-11-05 23:03:31 -08:00
Simon Willison 12df1a3b2a Show attachment types in llm models --options, closes #612 2024-11-05 22:49:26 -08:00
Simon Willison 0cc4072bcd Support attachments without prompts, closes #611 2024-11-05 21:27:18 -08:00
Simon Willison 336ab1013d gpt-4o-audio-preview audio input, refs #608 2024-11-05 21:08:52 -08:00
Simon Willison a7eedd1d2e mypy fix, refs #601
Test / test (macos-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.9) (push) Has been cancelled
 2024-11-01 14:21:01 -07:00
Simon Willison 122265a3d2 Fix for chat continuation in llm chat, refs #601 2024-11-01 14:17:25 -07:00
Simon Willison 389acdf52c Track usage on OpenAI stream requests, closes #591 2024-10-28 17:40:40 -07:00
Simon Willison be2953e6ab Ruff and mypy fixes 2024-10-28 15:41:34 -07:00
Simon Willison f0ed54abf1 Docs for CLI attachments, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison 570a3eccae Python attachment documentation, plus fixed a mimetype detection bug 
Refs #587
 2024-10-28 15:41:34 -07:00
Simon Willison 286cf9fcd9 attachments= keyword argument, tests pass again - refs #587 2024-10-28 15:41:34 -07:00
Simon Willison a9bc1c7329 llm logs --json for attachments, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison 2384fd52a0 Tighter log output for binary content 2024-10-28 15:41:34 -07:00
Simon Willison bb5b802d4f llm logs markdown support for attachments, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison 1126393ba1 Docs for writing models that accept attachments, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison a68af9c8e6 Don't redact non-data URLs for OpenAI models 
Refs #587
 2024-10-28 15:41:34 -07:00
Simon Willison cd722f653b Redact base64 data from _prompt_json, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison dff5b456fd Got llm --continue to work with images, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison c0fe719df6 Store prompt attachments in attachments and prompt_attachments tables 
Refs https://github.com/simonw/llm/issues/587#issuecomment-2439791231
 2024-10-28 15:41:34 -07:00
Simon Willison 6df00f92ff First working prototype of new attachments feature, refs #587 2024-10-28 15:41:34 -07:00
Simon Willison bfcfd2c91b o1-preview and o1-mini, refs #570 (#573) 2024-09-12 16:08:04 -07:00
Simon Willison e867e13d1b Use model_dump() instead of dict() 
Closes #554
 2024-08-18 17:39:09 -07:00
Simon Willison 6deed8f976 get_model() improvement, get_default_model() / set_default_wodel() now documented 
Refs #553
 2024-08-18 17:37:31 -07:00
Simon Willison 24cc042e59 Use self.get_key() in OpenAI Chat class, refs #552 2024-08-18 17:01:28 -07:00
Simon Willison 0ef5037b00 Remove obsolete DEFAULT_EMBEDDING_MODEL, closes #537 2024-07-18 12:22:17 -07:00
Simon Willison a83421607a Switch default model to gpt-4o-mini (from gpt-3.5-turbo), refs #536 2024-07-18 11:57:19 -07:00
Simon Willison 963a5ba467 gpt-4o-mini with alias 4o-mini, refs #536 2024-07-18 11:53:00 -07:00
Simon Willison 964f4d9934 Fix for llm logs -q plus -m bug, closes #515 2024-06-16 14:35:38 -07:00
Simon Willison 9a3236db61 gpt-4-turbo model ID, closes #493
Test / test (ubuntu-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.8) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.8) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.8) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.8) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.8) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.8) (push) Has been cancelled
 2024-05-13 13:37:23 -07:00
Simon Willison 0a8fd77b26 Fix for mypy error, closes #491 
This is why tests failed for #490
 2024-05-13 13:00:03 -07:00
Simon Willison 73bbbec372 gpt-4o model, refs #490 2024-05-13 12:49:45 -07:00
Simon Willison fb63c92cd2 llm logs -r/--response option, closes #431 2024-03-04 13:29:07 -08:00
Simon Willison 13ab8bb5fb Better HTTPX logging idiom, thanks @karpetrosyan 
https://github.com/encode/httpx/discussions/3073#discussioncomment-8263619

Refs #404
 2024-01-27 21:46:15 -08:00