315b8d1f62
Update README.md
2024-09-24 13:08:11 -07:00
5b2e3180fb
cuda mode -> gpu mode
...
This is a documentation only change. Hoping this is OK to merge. See this tweet for more context on why we made this change https://x.com/jeremyphoward/status/1838341110344880637
2024-09-23 17:09:45 -07:00
bd457aa19b
Merge pull request #724 from GaoYusong/master
...
add llm.cpp(a port of this project featuring a tinytorch.hpp library) link to notable forks in readme
2024-08-27 04:40:06 +09:00
25a302fde6
Update README.md
2024-08-10 17:53:12 +08:00
ed4c50dd6e
Merge branch 'master' into feature/llm.cpp
2024-08-10 17:51:49 +08:00
ee0a92f915
Add llm.cpp fork
2024-08-10 17:45:21 +08:00
74c0a59524
add llm.cpp link to notable forks in readme
2024-08-02 23:56:31 +08:00
85d17f4aa2
Merge pull request #668 from abhilash1910/tpc
...
Add Habana gaudi2 tpc kernel link
2024-07-15 18:22:15 -07:00
a6f6bc74a8
Merge pull request #682 from AnswerDotAI/master
...
Add a README link under related related projects for gpu.cpp under WebGPU C++
2024-07-13 10:12:59 -07:00
a86a69c135
Add nim port
2024-07-13 18:57:51 +03:00
ddd8aa0f34
add gpu.cpp link to related projects in readme
2024-07-12 14:42:24 -04:00
a2737d366a
add gaudi2 tpc kernel link
2024-07-04 00:34:13 +05:30
0aa0eb09a6
[readme] mention opencl fork
2024-06-26 20:32:21 +05:30
60c95c82aa
Add a multi node readme section
2024-06-24 18:50:56 +00:00
5b4d11ac1d
Add NCCL instruction
2024-06-21 00:16:17 +02:00
b29478e20b
add starter pack .sh script for faster quickstart
2024-06-19 01:44:36 +00:00
48b7885f72
Merge branch 'script_to_download_tokenized_dataset' of https://github.com/ChrisDryden/llm.c into ChrisDryden-script_to_download_tokenized_dataset
2024-06-19 01:29:54 +00:00
2a6797b1cd
Add debugging tip to README
2024-06-13 13:58:14 +02:00
3936492620
Forgot the folder name in the readme
2024-06-03 22:51:57 +00:00
027a43e0f5
Adds simplified way to download the already tokenized tinyshakespeare dataset and gpt2 weights
2024-06-03 22:49:50 +00:00
ed37d9261b
fix bug in readme
2024-05-30 21:39:47 +00:00
b48224cb0c
refactor the README file because it was getting crazy
2024-05-30 21:39:06 +00:00
fc40ffc4aa
adjust readme to new scripts/ dir
2024-05-30 20:10:04 +00:00
88dd670c42
link to recent post from readme
2024-05-28 17:31:31 +00:00
5ec4b774f2
simple jupyter notebook example on how to parse and vis the logfiles
2024-05-26 17:40:49 +00:00
5f87b13f34
Update documentation with Swift port reference
2024-05-23 21:15:01 +02:00
05be4f6d82
readme changes
2024-05-22 12:32:25 +00:00
54ccbd300c
docs on master-breaking changes around dataset file representation
2024-05-21 18:31:19 +00:00
f7cb77f3d9
docs on master-breaking change around how we store data .bin files
2024-05-21 18:20:51 +00:00
722e5b2fe5
refactor how we treat datasets, because we're about to have more of them and we don't want them to clutter up root dir etc. this is only step 1, i'm about to refactor a bunch of the dataloading, how the .bin files work and are loaded, how the DataLoader works, etc. This is all needed to support good evals and training at scale
2024-05-20 22:43:40 +00:00
3113656e3f
Add link to AMD fork
2024-05-16 13:33:34 -07:00
e64df91191
Add Llm.cs by nietras to README
2024-05-12 16:02:36 +02:00
6da5e63e2c
Fix detection of cudnn-frontend in '.' on Linux
...
Plus minor legibility fixes in the cudnn-frontend explanation.
2024-05-10 10:57:39 +03:00
8ccf2f97f8
Update README.md
2024-05-10 06:49:24 +08:00
69aa64cc80
Adds cuDNN install instructions for a smaller but sufficient package
...
- Modifies README.md to provide example apt-get cuDNN install instructions that install the cuDNN dev package. "sudo apt-get install -y cudnn" will install the default cuDNN packages, but for a minimal setup, installing the dev package will see a 50% reduction in both, download size (~850MB to 425MB now) and local storage size (~2GB to ~1GB now).
- Modifies the Makefile to point users to the README for cuDNN install instructions (through comments and the cuDNN install error message)
- Modifies attention_forward.cu comments to point users to the README for cuDNN install instructions
Signed-off-by: Vedaanta Agarwalla <vagarwalla@ipp2-1949.nvidia.com >
2024-05-08 14:53:31 -07:00
ff2fbdc2a1
Merge pull request #332 from harryjackson/llm.java
...
Adding a java port of the project
2024-05-03 13:58:59 -07:00
aa5dd2eeab
Update README.md
2024-05-03 12:43:08 -07:00
c13a730149
Merge branch 'master' into llm.java
2024-05-02 11:44:44 -07:00
69d40ebfff
add readme and search for cudd in home dir
2024-05-01 17:43:50 +00:00
78eba5fff3
Add llm.cpp fork to README
2024-04-30 18:52:42 -05:00
74d5bcd03a
Adding a java port of the project
2024-04-30 14:51:06 -07:00
d0b943ba04
Fix link to zig port
2024-04-29 11:18:03 +01:00
aedf3a5cdd
changes to readme for multigpu. i think this is ready now for v0 merge to master nice
2024-04-26 18:20:15 +00:00
8389fbaa0c
Merge branch 'multi_gpu_support' of https://github.com/PeterZhizhin/llm.c into PeterZhizhin-multi_gpu_support
2024-04-26 15:55:15 +00:00
d49e8301eb
[Multi-GPU] llm.c now runs on multiple GPUs with NCCL
2024-04-24 22:11:00 +00:00
0ee2d4a965
Add llm.go in description
2024-04-24 17:48:49 -04:00
e44ed15639
small updates on intent for fp32 and non-fp32 CUDA versions
2024-04-24 19:44:12 +00:00
b2c779d40e
Merge pull request #231 from Saimirbaci/zig-port-ref
...
Added ref to the zig port
2024-04-24 10:00:08 -07:00
c5f1db6020
fix important typo on precision
2024-04-23 17:43:19 +00:00
ed6387a695
updates to readme, and introduce the test fp32 cuda file too
2024-04-23 17:41:42 +00:00
Mark Saroufim