85d17f4aa2
Merge pull request #668 from abhilash1910/tpc
...
Add Habana gaudi2 tpc kernel link
2024-07-15 18:22:15 -07:00
a6f6bc74a8
Merge pull request #682 from AnswerDotAI/master
...
Add a README link under related related projects for gpu.cpp under WebGPU C++
2024-07-13 10:12:59 -07:00
a86a69c135
Add nim port
2024-07-13 18:57:51 +03:00
ddd8aa0f34
add gpu.cpp link to related projects in readme
2024-07-12 14:42:24 -04:00
a2737d366a
add gaudi2 tpc kernel link
2024-07-04 00:34:13 +05:30
0aa0eb09a6
[readme] mention opencl fork
2024-06-26 20:32:21 +05:30
60c95c82aa
Add a multi node readme section
2024-06-24 18:50:56 +00:00
5b4d11ac1d
Add NCCL instruction
2024-06-21 00:16:17 +02:00
b29478e20b
add starter pack .sh script for faster quickstart
2024-06-19 01:44:36 +00:00
48b7885f72
Merge branch 'script_to_download_tokenized_dataset' of https://github.com/ChrisDryden/llm.c into ChrisDryden-script_to_download_tokenized_dataset
2024-06-19 01:29:54 +00:00
2a6797b1cd
Add debugging tip to README
2024-06-13 13:58:14 +02:00
3936492620
Forgot the folder name in the readme
2024-06-03 22:51:57 +00:00
027a43e0f5
Adds simplified way to download the already tokenized tinyshakespeare dataset and gpt2 weights
2024-06-03 22:49:50 +00:00
ed37d9261b
fix bug in readme
2024-05-30 21:39:47 +00:00
b48224cb0c
refactor the README file because it was getting crazy
2024-05-30 21:39:06 +00:00
fc40ffc4aa
adjust readme to new scripts/ dir
2024-05-30 20:10:04 +00:00
88dd670c42
link to recent post from readme
2024-05-28 17:31:31 +00:00
5ec4b774f2
simple jupyter notebook example on how to parse and vis the logfiles
2024-05-26 17:40:49 +00:00
5f87b13f34
Update documentation with Swift port reference
2024-05-23 21:15:01 +02:00
05be4f6d82
readme changes
2024-05-22 12:32:25 +00:00
54ccbd300c
docs on master-breaking changes around dataset file representation
2024-05-21 18:31:19 +00:00
f7cb77f3d9
docs on master-breaking change around how we store data .bin files
2024-05-21 18:20:51 +00:00
722e5b2fe5
refactor how we treat datasets, because we're about to have more of them and we don't want them to clutter up root dir etc. this is only step 1, i'm about to refactor a bunch of the dataloading, how the .bin files work and are loaded, how the DataLoader works, etc. This is all needed to support good evals and training at scale
2024-05-20 22:43:40 +00:00
3113656e3f
Add link to AMD fork
2024-05-16 13:33:34 -07:00
e64df91191
Add Llm.cs by nietras to README
2024-05-12 16:02:36 +02:00
6da5e63e2c
Fix detection of cudnn-frontend in '.' on Linux
...
Plus minor legibility fixes in the cudnn-frontend explanation.
2024-05-10 10:57:39 +03:00
8ccf2f97f8
Update README.md
2024-05-10 06:49:24 +08:00
69aa64cc80
Adds cuDNN install instructions for a smaller but sufficient package
...
- Modifies README.md to provide example apt-get cuDNN install instructions that install the cuDNN dev package. "sudo apt-get install -y cudnn" will install the default cuDNN packages, but for a minimal setup, installing the dev package will see a 50% reduction in both, download size (~850MB to 425MB now) and local storage size (~2GB to ~1GB now).
- Modifies the Makefile to point users to the README for cuDNN install instructions (through comments and the cuDNN install error message)
- Modifies attention_forward.cu comments to point users to the README for cuDNN install instructions
Signed-off-by: Vedaanta Agarwalla <vagarwalla@ipp2-1949.nvidia.com >
2024-05-08 14:53:31 -07:00
ff2fbdc2a1
Merge pull request #332 from harryjackson/llm.java
...
Adding a java port of the project
2024-05-03 13:58:59 -07:00
aa5dd2eeab
Update README.md
2024-05-03 12:43:08 -07:00
c13a730149
Merge branch 'master' into llm.java
2024-05-02 11:44:44 -07:00
69d40ebfff
add readme and search for cudd in home dir
2024-05-01 17:43:50 +00:00
78eba5fff3
Add llm.cpp fork to README
2024-04-30 18:52:42 -05:00
74d5bcd03a
Adding a java port of the project
2024-04-30 14:51:06 -07:00
d0b943ba04
Fix link to zig port
2024-04-29 11:18:03 +01:00
aedf3a5cdd
changes to readme for multigpu. i think this is ready now for v0 merge to master nice
2024-04-26 18:20:15 +00:00
8389fbaa0c
Merge branch 'multi_gpu_support' of https://github.com/PeterZhizhin/llm.c into PeterZhizhin-multi_gpu_support
2024-04-26 15:55:15 +00:00
d49e8301eb
[Multi-GPU] llm.c now runs on multiple GPUs with NCCL
2024-04-24 22:11:00 +00:00
0ee2d4a965
Add llm.go in description
2024-04-24 17:48:49 -04:00
e44ed15639
small updates on intent for fp32 and non-fp32 CUDA versions
2024-04-24 19:44:12 +00:00
b2c779d40e
Merge pull request #231 from Saimirbaci/zig-port-ref
...
Added ref to the zig port
2024-04-24 10:00:08 -07:00
c5f1db6020
fix important typo on precision
2024-04-23 17:43:19 +00:00
ed6387a695
updates to readme, and introduce the test fp32 cuda file too
2024-04-23 17:41:42 +00:00
7f279cd6cb
Adding Zig port ref
2024-04-23 13:37:53 -04:00
451c1a4c99
update readme to point to SoU
2024-04-22 19:18:03 +00:00
38857ff1d0
Added llm.metal to notable forks
...
This is a fork of llm.c designed to take full advantage of Apple Silicon via the Metal framework. Just got the forward pass working and will start on the backward pass. I wrote a minimal C wrapper API over the Objective-C Metal API that was needed to set up and run compute shaders. The rest of the code is pure-C and Metal Shading Language. I'm trying to mirror the original repo as closely as possible both in code and project philosophy.
2024-04-22 09:01:21 -07:00
43ffd2af8a
add Rust port to notable forks
2024-04-21 19:23:50 -02:30
7fa9f7b140
document one way to do experiments / sweeps as just an example
2024-04-20 19:39:12 +00:00
7df2d4d92b
also requirements for quick start
2024-04-20 00:59:32 +00:00
38fd42d3e3
also add a quick start CPU section
2024-04-20 00:41:13 +00:00
Andrej