mirrors / karpathy--llm.c

文件历史

809 提交 53 分支 0 Git 标签
feature/organize_data
提交图

2 次代码提交

作者 SHA1 备注 提交日期
Andrej Karpathy 1defbd4a19 adjust the dataloader to load the new .bin data files, and both prod datasets to use it instead 2024-05-21 17:05:27 +00:00
Andrej Karpathy 4bbd01fe12 add fineweb, and add the first version of a new write_shard function that contains a header properly 2024-05-21 00:16:07 +00:00