1fe46f66f8
Add GELU activation function
...
Implemented GELU activation using tanh approximation
2026-05-07 08:00:42 +05:30
4e93532b6f
Format using ruff
2025-06-16 01:15:27 +04:00
d20d3130d6
fix gradient descent optimization algorithm link
...
sebastian ruder updated the domain of his site.
2022-01-30 18:51:43 -05:00
3c8e16b8de
Merge pull request #79 from Shihab-Shahriar/master
...
Fixed a bug in decision tree's _calculate_leaf_value method
2020-09-14 01:16:40 +03:00
ef5aca0ae3
Apply suggestions from code review
2020-09-14 01:13:43 +03:00
2378011a2c
Style fixes
2020-08-20 22:56:03 +03:00
ffbe4085e2
Minor fixes
2020-08-20 22:43:06 +03:00
60ee2893c2
refactored Decision Tree to support n_classes
2020-05-29 20:12:48 +06:00
fbb730844d
resolved bug when all labels in leaf node are 0
2020-05-29 19:25:18 +06:00
30e4c49f44
small code cleanup
2020-05-29 18:32:01 +06:00
0b9ebf3a99
resolved classification bug in decision tree using n_classes
2020-05-28 20:17:03 +06:00
ad58bf49f2
Add Mode as rt to avoid str Object decoding issue
2020-02-26 01:07:45 -08:00
68522f2e6d
Change open function mode for decode issue
2020-02-24 11:19:10 -08:00
bcf95627fa
Fix the rbm example via delete unnecessary decode on str Object in mla/datasets/base.py line 54
2020-02-23 23:44:38 -08:00
601c817cb4
fix typo when calculating intercept in simplified SMO algorithm
2019-11-29 13:33:39 +08:00
0d1022ee46
Improve SVM test
2019-10-02 15:35:46 +03:00
fff1c2832b
Add Adamax optimizer and unit test
2019-10-01 19:34:27 -04:00
ba450f87c4
Minor fixes
2019-08-25 19:59:26 +03:00
d2de145bf1
Fix plot for k-means. Resolves #54
2019-07-22 14:13:53 +03:00
62633dd302
Format code using black
2019-05-11 18:15:53 +03:00
c5cc88ea48
bug fix env.close()
2019-03-14 12:13:55 +01:00
8f49f660e9
bug fix self.memory_limit
2019-03-13 16:06:05 +01:00
9f22724a36
pip install . - bug fix - mla/rl was missing
2019-03-12 17:20:23 +01:00
31c38db00b
fix sigmoid function
2019-03-12 13:34:20 +08:00
8f4f1339ba
Merge pull request #47 from LanderTome/feature-branch_normalization
...
Add a basic implementation of Batch Normalization.
2019-02-18 14:35:22 +03:00
528d623fd6
Update normalization.py
2019-02-18 14:34:59 +03:00
49c51758fe
Add a basic implementation of Batch Normalization.
...
Adapted from https://kratzert.github.io/2016/02/12/understanding-the-gradient-flow-through-the-batch-normalization-layer.html
A more efficient algorithm could probably be used, but this one seems pretty easy to understand.
2019-02-17 23:25:27 -08:00
4e980800b7
Add total size of batch iterations to tqdm loop so that it displays estimated time to completion.
2019-02-17 22:57:22 -08:00
b8ad378a79
Add Leaky ReLU activation.
...
Differentiation with autograd package confirmed to work correctly.
2019-02-13 13:51:13 -08:00
602d3b6fd9
Fix reduction test
2019-01-25 12:27:34 +03:00
cd6689c12a
kmeans++
...
It seems the codes do not match with the comment starting from line 33.
Revise it according to the comments.
2019-01-07 17:02:36 +08:00
e253211090
Get the derivative of the loss function out of the for loop ( #42 )
...
I think getting the derivative of the loss function should be out of the for loop. There is no need to calculate the derivative function for max iteration times.
2018-10-23 08:18:21 +03:00
5fbfeca8c4
Update test_regression_accuracy.py
2018-10-21 23:46:12 +03:00
64d7c51d00
Fix the formula of l2 penalty ( #40 )
2018-10-21 23:45:45 +03:00
6b729f043e
update the penalty function in linear models ( #36 )
2018-06-30 16:48:41 +03:00
d398777642
Fix softplus overflow (attempt 2) ( #31 )
...
* actually fix numeric overflow
2017-08-17 11:56:34 +03:00
4b3c24dfce
Fix for Numeric Overflow of softplus implementation ( #30 )
...
* fix possible numeric overflow for softplus
* english
2017-08-12 07:24:05 +03:00
2b798428d8
Update rbm.py
2017-03-27 11:48:39 +07:00
b7364b560d
Fix the CD-1 training code and add comments in RBM ( #29 )
...
1. `negative_visible` should also be sampled, only the last hidden can use the expectation. Though trivial modification, it follows the original algorithm, and theorically it should also be done (refer to Kevin Murphy's MLaPP P944).
2. Some comments are added in the code, for more friendly reading. At the first sight I didn't find it's CD :)
2017-03-27 08:13:32 +07:00
96397f5ff8
Fix typo ( #28 )
2017-03-23 08:09:30 +07:00
aa41a68676
fixes missing log ( #26 )
2017-02-15 17:54:25 +03:00
12e7c8770e
Update some comments
2017-01-23 06:09:34 +03:00
7f0836b22a
Fix mlp test
2017-01-08 05:51:51 +03:00
766ee72969
Add some comments to DQN module
2017-01-08 04:50:45 +03:00
63b00ff95f
Add initial version of Deep Q learning (DQN)
2017-01-08 04:37:44 +03:00
6b46afa7cc
Update neural network interface, FIX bug in optimization
2017-01-08 04:35:12 +03:00
f24fe1d4d8
Add initial t-SNE implementation
2016-12-28 19:04:40 +03:00
cd261f9afc
Update Readme, fix test
2016-12-26 22:30:39 +03:00
6528cf5d89
Add initial version of rbm
2016-12-26 22:28:48 +03:00
b060229349
Fix entropy function, #22
2016-12-21 00:02:41 +03:00
Adi-474u