7f4e95a68d
Merge pull request #183 from AlpinDale/patch-2
...
Enhance GPU `bfloat16` support check
2023-07-24 02:11:34 -07:00
eee4f88f29
Merge pull request #178 from ranchlai/main
...
Add trust_remote_code for AutoTokenizer
2023-07-24 02:07:58 -07:00
5486baa59a
Merge branch 'main' into main
2023-07-24 02:07:28 -07:00
76d86645b8
Merge pull request #219 from abhilash1910/main
...
Enable Qlora scripts on Intel GPUs
2023-07-24 01:25:03 -07:00
82c730a48a
Merge pull request #143 from bubundas17/patch-1
...
Fixed Local .jsonl dataset loading
2023-07-24 01:15:44 -07:00
965f8b3430
generage example
2023-07-23 15:05:52 -07:00
6c6fc4653a
Merge pull request #220 from artidoro/llama2
...
Example for LLaMA2 Finetuning and Version Update
2023-07-19 06:21:46 -07:00
b0d2fe0dc2
cleanup
2023-07-19 06:20:03 -07:00
68ff19681f
example llama2 finetuning
2023-07-19 04:54:48 -07:00
4a3e5ddc0f
Merge pull request #217 from ffohturk/main
...
Updated qlora.py to fix freezing of embedding layers
2023-07-19 04:15:38 -07:00
a9644b4154
xpu support
2023-07-19 04:01:03 -07:00
a17d93e6fd
xpu support
2023-07-19 00:47:53 -07:00
61dfbe287e
Updated qlora.py
...
Updated the way embeddings are frozen. First load the base model, then resize tokenizer, then do prepare_for_kbit_training to freeze the model's original weights, then LoRA-fy and then train.
2023-07-19 02:03:36 +03:00
190d22aa4b
Merge pull request #215 from artidoro/embeddingfix
...
Freezing embeddings and adding known issue message
2023-07-18 11:47:58 -07:00
5111741384
freezing embeddings and known issue
2023-07-18 04:22:33 -07:00
845188de11
Update README.md
2023-07-17 09:00:28 -07:00
0fc40da9dc
Enhances GPU bfloat16 support check
2023-06-22 16:06:06 +00:00
af90b31d5a
add trust_remote_code for AutoTokenizer
2023-06-19 00:44:14 +08:00
6d6a2ed677
Merge branch 'artidoro:main' into patch-1
2023-06-09 22:02:16 +05:30
cc488110b5
human ratings
2023-06-08 13:20:51 -07:00
9c6e450468
Fixed Local .jsonl dataset loading
2023-06-08 00:18:53 +05:30
3da535abdf
Merge pull request #101 from dameikle/main
...
Added use_auth_token to model arguments to load private models
2023-06-06 11:49:29 -07:00
4ea02e7464
Merge pull request #126 from tobi/rank-and-files
...
Rank and files
2023-06-06 11:43:50 -07:00
f4ee7fd786
Update qlora.py
...
Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com >
2023-06-06 11:31:24 -07:00
00e5ad2a75
pandas is better at reading lines
2023-06-03 19:46:39 -04:00
bed4b0d863
typo
2023-06-03 19:42:49 -04:00
e69303d556
introduce LOCAL_RANK mapping and optiojn to leave input data as-is
2023-06-03 19:30:39 -04:00
bdc655dfa7
Merge pull request #102 from steremma/steremma-patch-1
...
Respect cache_dir passed by user
2023-06-01 07:37:40 -07:00
986c500c5b
Respect cache_dir passed by user
...
When the user overrides default `cache_dir` we should respect it not only for tokenizer but also for the model
2023-06-01 13:40:55 +02:00
86ac6016f6
Update the scripts with HF checkpoints
2023-05-31 22:44:30 -07:00
8ee760d80e
Added use_auth_token to model arguments to load private models
2023-06-01 06:14:32 +01:00
43643cab5d
Reordering README.md
2023-05-31 20:22:15 -07:00
e598fe8f8f
multi-gpu discussion
2023-05-31 20:20:00 -07:00
0b46ca80a0
add guanaco repro scripts
2023-05-31 20:17:51 -07:00
a45718eec2
fix tokenization issues
2023-05-31 19:52:43 -07:00
5f618e7e90
oasst1 and bug fixes
2023-05-31 18:16:00 -07:00
460525b4fe
gitignore
2023-05-31 18:12:47 -07:00
d69e26db70
requirements
2023-05-31 16:41:29 -07:00
94e50419e3
Merge pull request #86 from dred0n/feature-local-training-data
...
add support local training data
2023-05-31 14:27:33 -07:00
d9f201c2b6
Merge pull request #79 from KKcorps/resume_patch
...
Bug Fix: Resume training from checkpoints
2023-05-31 14:22:00 -07:00
9991dc555c
Update README.md
2023-05-30 13:34:46 -07:00
7e1e81445b
Merge pull request #44 from KKcorps/empty_adapter_patch
...
Bug Fix: 443 Bytes `adapter_model.bin` files
2023-05-30 11:56:00 -07:00
ace51b6e34
add jsonl local dataset support
2023-05-30 10:45:11 -05:00
2e21c16297
add csv, tsv support
2023-05-30 09:43:49 -05:00
c06d702e5f
add support local training set support
2023-05-30 08:52:20 -05:00
163adf26a6
Only load adapter weights on resume
2023-05-29 14:57:21 +05:30
f96eec1675
Merge pull request #63 from pmysl/main
...
Suppress pad_token warning message
2023-05-28 13:46:32 -07:00
e31aedd4ba
Suppress pad_token warning message
2023-05-28 14:00:12 +02:00
ce5e5be9de
Merge pull request #58 from muelletm/patch-1
...
Set per_device_eval_batch_size in finetune.sh
2023-05-27 20:32:24 -07:00
204dda82c4
Merge pull request #51 from pmysl/main
...
Fix link to inference notebook
2023-05-27 20:29:42 -07:00
Artidoro Pagnoni