 Adi-474u
|
1fe46f66f8
|
Add GELU activation function
Implemented GELU activation using tanh approximation
|
2026-05-07 08:00:42 +05:30 |
|
|
Artem Golubin
|
4e93532b6f
|
Format using ruff
|
2025-06-16 01:15:27 +04:00 |
|
|
Paul Inder
|
d20d3130d6
|
fix gradient descent optimization algorithm link
sebastian ruder updated the domain of his site.
|
2022-01-30 18:51:43 -05:00 |
|
|
Artem Golubin
|
2378011a2c
|
Style fixes
|
2020-08-20 22:56:03 +03:00 |
|
|
Artem Golubin
|
ffbe4085e2
|
Minor fixes
|
2020-08-20 22:43:06 +03:00 |
|
|
Antetokounpo
|
fff1c2832b
|
Add Adamax optimizer and unit test
|
2019-10-01 19:34:27 -04:00 |
|
|
Artem Golubin
|
ba450f87c4
|
Minor fixes
|
2019-08-25 19:59:26 +03:00 |
|
|
Artem Golubin
|
62633dd302
|
Format code using black
|
2019-05-11 18:15:53 +03:00 |
|
|
Artem Golubin
|
8f4f1339ba
|
Merge pull request #47 from LanderTome/feature-branch_normalization
Add a basic implementation of Batch Normalization.
|
2019-02-18 14:35:22 +03:00 |
|
|
Artem Golubin
|
528d623fd6
|
Update normalization.py
|
2019-02-18 14:34:59 +03:00 |
|
|
Robert Wukmir
|
49c51758fe
|
Add a basic implementation of Batch Normalization.
Adapted from https://kratzert.github.io/2016/02/12/understanding-the-gradient-flow-through-the-batch-normalization-layer.html
A more efficient algorithm could probably be used, but this one seems pretty easy to understand.
|
2019-02-17 23:25:27 -08:00 |
|
|
Robert Wukmir
|
4e980800b7
|
Add total size of batch iterations to tqdm loop so that it displays estimated time to completion.
|
2019-02-17 22:57:22 -08:00 |
|
|
Robert Wukmir
|
b8ad378a79
|
Add Leaky ReLU activation.
Differentiation with autograd package confirmed to work correctly.
|
2019-02-13 13:51:13 -08:00 |
|
|
Yiran Sheng
|
d398777642
|
Fix softplus overflow (attempt 2) (#31)
* actually fix numeric overflow
|
2017-08-17 11:56:34 +03:00 |
|
|
Yiran Sheng
|
4b3c24dfce
|
Fix for Numeric Overflow of softplus implementation (#30)
* fix possible numeric overflow for softplus
* english
|
2017-08-12 07:24:05 +03:00 |
|
|
rushter
|
6b46afa7cc
|
Update neural network interface, FIX bug in optimization
|
2017-01-08 04:35:12 +03:00 |
|
|
rushter
|
21b090dafe
|
Fix neuralnet test
|
2016-11-26 03:23:34 +03:00 |
|
|
rushter
|
830f68a905
|
Add some comments to the neuralnets
|
2016-11-20 21:53:26 +03:00 |
|
|
lucaskolstad
|
63878210db
|
fixes and formatting for examples
|
2016-11-15 12:28:44 -08:00 |
|
|
rushter
|
6909aec940
|
Update scikit-learn
|
2016-10-28 17:48:52 +03:00 |
|
|
rushter
|
501659db2a
|
Remove cache file
|
2016-10-06 11:41:39 +03:00 |
|
|
rushter
|
feaa836a7f
|
Initial branch
|
2016-10-06 11:36:35 +03:00 |
|