6cf4127ea7
o1-preview and o1-mini can stream now
...
Test / test (windows-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.13) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.13) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.10) (push) Has been cancelled
Refs https://github.com/simonw/llm/issues/676#issuecomment-2549328154
2024-12-17 10:52:28 -08:00
8378da6329
Fix for UTC warnings
2024-12-12 14:48:07 -08:00
491dd9b437
Removed accidental comment
2024-12-05 13:45:50 -08:00
b6be09aa28
Fix get_models() and get_async_models() duplicates bug
...
Closes #667 , refs #640
2024-12-05 13:44:07 -08:00
cfb10f4afd
Log input tokens, output tokens and token details ( #642 )
...
* Store input_tokens, output_tokens, token_details on Response, closes #610
* llm prompt -u/--usage option
* llm logs -u/--usage option
* Docs on tracking token usage in plugins
* OpenAI default plugin logs usage
2024-11-19 20:21:59 -08:00
cf172cc70a
response.text_or_raise() workaround
...
Closes https://github.com/simonw/llm/issues/632
2024-11-14 15:08:41 -08:00
ba75c674cb
llm.get_async_model(), llm.AsyncModel base class and OpenAI async models ( #613 )
...
- https://github.com/simonw/llm/issues/507#issuecomment-2458639308
* register_model is now async aware
Refs https://github.com/simonw/llm/issues/507#issuecomment-2458658134
* Refactor Chat and AsyncChat to use _Shared base class
Refs https://github.com/simonw/llm/issues/507#issuecomment-2458692338
* fixed function name
* Fix for infinite loop
* Applied Black
* Ran cog
* Applied Black
* Add Response.from_row() classmethod back again
It does not matter that this is a blocking call, since it is a classmethod
* Made mypy happy with llm/models.py
* mypy fixes for openai_models.py
I am unhappy with this, had to duplicate some code.
* First test for AsyncModel
* Still have not quite got this working
* Fix for not loading plugins during tests, refs #626
* audio/wav not audio/wave, refs #603
* Black and mypy and ruff all happy
* Refactor to avoid generics
* Removed obsolete response() method
* Support text = await async_mock_model.prompt("hello")
* Initial docs for llm.get_async_model() and await model.prompt()
Refs #507
* Initial async model plugin creation docs
* duration_ms ANY to pass test
* llm models --async option
Refs https://github.com/simonw/llm/pull/613#issuecomment-2474724406
* Removed obsolete TypeVars
* Expanded register_models() docs for async
* await model.prompt() now returns AsyncResponse
Refs https://github.com/simonw/llm/pull/613#issuecomment-2475157822
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-11-13 17:51:00 -08:00
7520671176
audio/wav not audio/wave, refs #603
2024-11-12 21:43:07 -08:00
3352eb9f57
Serialize usage to JSON properly, closes #614
2024-11-06 03:27:25 -08:00
3b2e5263a3
Allow passing of can_stream in openai_models.py ( #600 )
...
* Allow passing of can_stream in openai_models.py
Fixes #599
* Only set can_stream: false if it is false
Refs https://github.com/simonw/llm/pull/600#issuecomment-2458825866
* Docs for can_stream: false
---------
Co-authored-by: Simon Willison <swillison@gmail.com >
2024-11-05 23:04:13 -08:00
12df1a3b2a
Show attachment types in llm models --options, closes #612
2024-11-05 22:49:26 -08:00
0cc4072bcd
Support attachments without prompts, closes #611
2024-11-05 21:27:18 -08:00
336ab1013d
gpt-4o-audio-preview audio input, refs #608
2024-11-05 21:08:52 -08:00
389acdf52c
Track usage on OpenAI stream requests, closes #591
2024-10-28 17:40:40 -07:00
a68af9c8e6
Don't redact non-data URLs for OpenAI models
...
Refs #587
2024-10-28 15:41:34 -07:00
cd722f653b
Redact base64 data from _prompt_json, refs #587
2024-10-28 15:41:34 -07:00
dff5b456fd
Got llm --continue to work with images, refs #587
2024-10-28 15:41:34 -07:00
6df00f92ff
First working prototype of new attachments feature, refs #587
2024-10-28 15:41:34 -07:00
bfcfd2c91b
o1-preview and o1-mini, refs #570 ( #573 )
2024-09-12 16:08:04 -07:00
e867e13d1b
Use model_dump() instead of dict()
...
Closes #554
2024-08-18 17:39:09 -07:00
24cc042e59
Use self.get_key() in OpenAI Chat class, refs #552
2024-08-18 17:01:28 -07:00
963a5ba467
gpt-4o-mini with alias 4o-mini, refs #536
2024-07-18 11:53:00 -07:00
9a3236db61
gpt-4-turbo model ID, closes #493
Test / test (ubuntu-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.8) (push) Has been cancelled
Test / test (ubuntu-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.8) (push) Has been cancelled
Test / test (windows-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.8) (push) Has been cancelled
Test / test (windows-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.8) (push) Has been cancelled
Test / test (macos-latest, ==1.10.2, 3.9) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.10) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.11) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.12) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.8) (push) Has been cancelled
Test / test (macos-latest, >=2.0.0, 3.9) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.10) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.11) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.12) (push) Has been cancelled
Test / test (ubuntu-latest, ==1.10.2, 3.8) (push) Has been cancelled
2024-05-13 13:37:23 -07:00
73bbbec372
gpt-4o model, refs #490
2024-05-13 12:49:45 -07:00
a06bef8f83
default_headers, not headers - fixes llm-openrouter, refs #401
2024-01-26 13:42:34 -08:00
0f8ffbfbbd
Fix compatibility with llm-anyscale-endpoints, refs #401
2024-01-26 13:35:03 -08:00
1f67f14cdb
Re-implemented LLM_OPENAI_SHOW_RESPONSES against httpx
...
Closes #404
Refs #364
2024-01-26 10:33:03 -08:00
214fcaaf86
Upgrade to run against OpenAI >= 1.0
...
* strategy: fail-fast: false - to help see all errors
* Apply latest Black
Refs #325
2024-01-25 22:00:44 -08:00
5bed6f13af
gpt-4-1106-preview, gpt-4-0125-preview, gpt-4-turbo-preview models - refs #396
2024-01-25 15:13:55 -08:00
a1b97c06e6
3-small-512, 3-large-256, 3-large-1024 embedding models, refs #394
2024-01-25 13:22:21 -08:00
044689351d
Support new OpenAI embeddings models, refs #394
2024-01-25 13:10:41 -08:00
184273876f
Fix for json_object tests I broke in #373
2024-01-25 13:04:05 -08:00
53f80dd531
-o json_object 1 option for OpenAI Chat models, refs #373
2024-01-25 12:51:14 -08:00
b2a12727f1
Add GPT 4 turbo model and -o seed 1 option ( #329 )
...
Closes #323
Closes #324
2023-11-06 13:32:04 -08:00
31b02ecfd6
Actually do the gpt-4-turbo work in a branch, refs #323
...
This reverts commit 2bfd039ff4
2023-11-06 10:17:36 -08:00
2bfd039ff4
Guessing model will be gpt-4-turbo - refs #323
...
This doesn't work yet though, they have not released the model.
2023-11-06 10:16:45 -08:00
b4ec54ef19
NotImplementedError for system prompts with OpenAI completion models, refs #284
...
Signed-off-by: Simon Willison <swillison@gmail.com >
2023-09-18 22:51:22 -07:00
f76b2120e4
Revert "Handle system prompts for completion models, refs #284 "
...
This reverts commit 4eed871cf1#288
2023-09-18 22:44:38 -07:00
4eed871cf1
Handle system prompts for completion models, refs #284
2023-09-18 22:36:38 -07:00
fcff36c6bc
completion: true to register completion models, refs #284
2023-09-18 22:17:26 -07:00
4fea46113f
logprobs support for OpenAI completion models, refs #284
2023-09-18 22:04:28 -07:00
ae14ce4add
LLM_OPENAI_SHOW_RESPONSES=1 debug trick, closes #286
2023-09-18 21:13:42 -07:00
4d18da4e11
Bump default gpt-3.5-turbo-instruct max tokens to 256, refs #284
2023-09-18 20:29:39 -07:00
4d46ebaa32
OpenAI completion models including gpt-3.5-turbo-instruct, refs #284
2023-09-18 18:34:32 -07:00
52cec1304b
Binary embeddings ( #254 )
...
* Binary embeddings support, refs #253
* Write binary content to content_blob, with tests - refs #253
* supports_text and supports_binary embedding validation, refs #253
2023-09-11 18:58:44 -07:00
e49c816e18
Drop llm.EmbeddingModel.embedding_size property, closes #208
2023-09-02 08:45:17 -07:00
7a4429f100
Fix mypy errors
...
Refs https://github.com/simonw/llm/issues/191#issuecomment-1703266224
2023-09-01 13:14:59 -07:00
817aff8bae
Embeddings now happen in batches, closes #200
2023-08-31 22:27:06 -07:00
77cf56e54a
Initial CLI support and plugin hook for embeddings, refs #185
...
* Embeddings plugin hook + OpenAI implementation
* llm.get_embedding_model(name) function
* llm embed command, for returning embeddings or saving them to SQLite
* Tests using an EmbedDemo embedding model
* llm embed-models list and emeb-models default commands
* llm embed-db path and llm embed-db collections commands
2023-08-27 22:24:10 -07:00
a105d98b58
Ignore mypy error, refs #169
2023-08-19 21:35:35 -07:00
Simon Willison