louistiti
|
7ecb8589fb
|
Merge branch 'develop' into feat/widgets
|
2024-07-28 21:11:07 +08:00 |
|
louistiti
|
feebb22094
|
feat: upgrade typescript to 5.5.4
|
2024-07-28 21:10:49 +08:00 |
|
louistiti
|
98be8a0022
|
feat: widget hydration (WIP)
|
2024-07-28 21:09:21 +08:00 |
|
louistiti
|
e135a5fcce
|
feat: upgrade typescript to 5.5.3
|
2024-07-17 10:03:49 +08:00 |
|
louistiti
|
d23925c7d5
|
perf(bridge/nodejs): faster cold start by avoiding to compile unnecessary chunks
|
2024-07-17 09:47:27 +08:00 |
|
louistiti
|
f8289fa809
|
chore: upgrade React to latest
|
2024-07-16 09:38:51 +08:00 |
|
louistiti
|
fd5e952695
|
feat(server): enable FlashAttention for faster inference
|
2024-07-14 21:19:42 +08:00 |
|
louistiti
|
626c77d340
|
feat(server): upgrade node-llama-cpp to 3.0.0-beta.38
|
2024-07-14 21:16:40 +08:00 |
|
louistiti
|
ac3e61d7b2
|
feat(server): allow custom LLM duties from skills
|
2024-07-07 18:48:47 +08:00 |
|
louistiti
|
db33126664
|
fix(server): update duties system prompt on mood and context info set
|
2024-07-07 17:49:37 +08:00 |
|
louistiti
|
822e20f80b
|
fix(scripts): remove description property on LLM action classifier training
|
2024-07-07 16:03:20 +08:00 |
|
louistiti
|
c21051b9a7
|
feat(server): upgrade llama.cpp to b3322 release; node-llama-cpp to node-llama-cpp
|
2024-07-07 15:51:34 +08:00 |
|
louistiti
|
dcda888de6
|
fix(server): persona typo
|
2024-07-04 09:21:02 +08:00 |
|
louistiti
|
0c775ba2e5
|
feat: use VRAM as LLM unit requirements
|
2024-07-03 23:41:23 +08:00 |
|
louistiti
|
6867e9c6db
|
feat(server): VRAM helpers
|
2024-07-03 13:42:10 +08:00 |
|
louistiti
|
1334c2013c
|
feat(server): has GPU helper
|
2024-07-03 13:34:05 +08:00 |
|
louistiti
|
94885de71b
|
feat(server): get graphics compute API
|
2024-07-03 13:31:26 +08:00 |
|
louistiti
|
b86775846b
|
feat(server): get GPU device names
|
2024-07-03 13:24:53 +08:00 |
|
louistiti
|
4019bd877b
|
chore: better comments on LLM action matching
|
2024-07-03 09:11:25 +08:00 |
|
louistiti
|
7e483b9123
|
feat: add inspect:gpu npm script
|
2024-07-02 22:12:48 +08:00 |
|
louistiti
|
ee615e6ade
|
refactor(python tcp server): rename the RMS threshold setting for ASR
|
2024-07-01 22:53:34 +08:00 |
|
louistiti
|
b092947e2e
|
feat(web app): add headset tips for a better voice experience
|
2024-07-01 22:52:16 +08:00 |
|
louistiti
|
1d96655b01
|
fix(python tcp server): overflowed on ASR
|
2024-07-01 22:28:18 +08:00 |
|
louistiti
|
8ed7c78074
|
fix(web app): use correct config property for LLM warm up
|
2024-07-01 09:45:58 +08:00 |
|
louistiti
|
be3df774dc
|
feat(server): boost free RAM delta for LLM
|
2024-07-01 09:38:20 +08:00 |
|
louistiti
|
2c89041b3f
|
feat(server): upgrade node-llama-cpp to 3.0.0-beta.36
|
2024-07-01 09:03:02 +08:00 |
|
louistiti
|
e4277bfcf4
|
feat(web app): add more info data
|
2024-06-30 20:04:08 +08:00 |
|
louistiti
|
2e351d4218
|
feat(web app): add info
|
2024-06-30 19:58:26 +08:00 |
|
louistiti
|
e24dee3b07
|
feat(server): VRAM context size management
|
2024-06-30 19:15:24 +08:00 |
|
louistiti
|
8eeff3a01c
|
feat(python tcp server): map speech synthesis hardware device choice to settings
|
2024-06-30 16:54:59 +08:00 |
|
louistiti
|
a05f34422e
|
feat(server): upgrade node-llama-cpp to 3.0.0-beta.34
|
2024-06-30 16:47:57 +08:00 |
|
louistiti
|
74241b43fe
|
feat(python tcp server): run speech synthesis inference on CPU
|
2024-06-30 16:30:12 +08:00 |
|
louistiti
|
fae15c9f4d
|
feat(server): kill existing PyTorch thread from TCP server on start
|
2024-06-30 16:03:11 +08:00 |
|
louistiti
|
2c1b35144d
|
feat(server): use debug verbosity by default in LLM manager
|
2024-06-30 15:54:51 +08:00 |
|
louistiti
|
c25c52532f
|
feat(server): increase LLM threads number
|
2024-06-30 15:54:12 +08:00 |
|
louistiti
|
805c65b2b2
|
fix(web app): init state when shouldWarmUpLLM is not enabled
|
2024-06-30 15:53:49 +08:00 |
|
louistiti
|
0bb61e5301
|
Merge remote-tracking branch 'origin/develop' into develop
|
2024-06-29 23:29:52 +08:00 |
|
louistiti
|
d2038061e7
|
feat(server): disable onToken when LLM duties are warming up
|
2024-06-29 23:29:25 +08:00 |
|
Louis Grenard
|
7a42f4df93
|
feat(server): disable onToken when LLM duties are warming up
|
2024-06-29 23:28:19 +08:00 |
|
louistiti
|
ed9961c822
|
feat(server): sync LLM duties warmup with UI
|
2024-06-27 23:36:32 +08:00 |
|
louistiti
|
fb91551364
|
feat(server): warm up LLM duties when necessary (WIP)
|
2024-06-25 23:49:09 +08:00 |
|
louistiti
|
8dc725a697
|
refactor(scripts): differentiate PyTorch info log on macOS
|
2024-06-24 08:28:32 +08:00 |
|
louistiti
|
6c3abf30b0
|
fix(server): sometimes the action recognition LLM duty add whitespace to intent
|
2024-06-23 23:36:11 +08:00 |
|
louistiti
|
1314217e00
|
BREAKING: upgrade from Python 3.9 to Python 3.11
|
2024-06-23 23:29:09 +08:00 |
|
louistiti
|
871617649a
|
chore(bridge/python): upgrade cx_Freeze to 7.1.1
|
2024-06-23 22:42:42 +08:00 |
|
louistiti
|
85c3a40457
|
chore(python tcp server): upgrade cx_Freeze to 7.1.1
|
2024-06-23 22:41:46 +08:00 |
|
louistiti
|
0661e9e04f
|
refactor(scripts): only install PyTorch when the targeted setup is the TCP server
|
2024-06-23 22:39:39 +08:00 |
|
louistiti
|
6045eb5105
|
feat(server): speed up translation LLM duty
|
2024-06-23 22:27:12 +08:00 |
|
louistiti
|
72954a3557
|
feat(server): speed up summarization LLM duty
|
2024-06-23 22:13:36 +08:00 |
|
louistiti
|
cd65b84b7c
|
feat(server): init LLM duty on inference requested by skills
|
2024-06-23 18:47:58 +08:00 |
|