tiny_dnn  1.0.0
A header only, dependency-free deep learning framework in C++11
Public Member Functions | Public Attributes | List of all members
tiny_dnn::adam Struct Reference

[a new optimizer (2015)] More...

#include <optimizer.h>

Inheritance diagram for tiny_dnn::adam:
Inheritance graph
[legend]
Collaboration diagram for tiny_dnn::adam:
Collaboration graph
[legend]

Public Member Functions

void update (const vec_t &dW, vec_t &W, bool parallelize)
 
- Public Member Functions inherited from tiny_dnn::stateful_optimizer< 2 >
void reset () override
 
- Public Member Functions inherited from tiny_dnn::optimizer
 optimizer (const optimizer &)=default
 
 optimizer (optimizer &&)=default
 
optimizeroperator= (const optimizer &)=default
 
optimizeroperator= (optimizer &&)=default
 

Public Attributes

float_t alpha
 
float_t b1
 
float_t b2
 
float_t b1_t
 
float_t b2_t
 

Additional Inherited Members

- Protected Member Functions inherited from tiny_dnn::stateful_optimizer< 2 >
vec_t & get (const vec_t &key)
 
- Protected Attributes inherited from tiny_dnn::stateful_optimizer< 2 >
std::unordered_map< const vec_t *, vec_t > E_ [N]
 

Detailed Description

[a new optimizer (2015)]

[see Adam: A Method for Stochastic Optimization (Algorithm 1) http://arxiv.org/abs/1412.6980]


The documentation for this struct was generated from the following file: