Distance Metric Learning Using Dropout Essay

1329 Words Jul 10th, 2015 6 Pages
Distance Metric Learning Using Dropout:
A Structured Regularization Approach


Zhe Cheng
Instructor: Dr. Ikhlas Abdel-Qader
1.Understanding dropout
2.DML using dropout
3.Applying Dropout to Distance Metric
4.Applying Dropout to Training Data
5 .Conclusion 1.Dropout
Dropout prevention overfit , and offers many ways a different neural network effectively about the combination index . The term " pressure " refers to the shedding units (hidden and visible) in a neural network. By reducing a unit , we mean temporarily removed from the network, along with all of its incoming and outgoing connections , shown in Figure 1 , in which the unit is a random selection of decline . In the simplest case , each unit is maintained fixed probability p independently of other units , where p can be selected using the validation set , or may simply be set to 0.5 and , it seems to be near optimum for a wide range of network and tasks. An input unit , however , is generally reserved for the best probability close to 1 to 0.5 .

With unlimited calculations to "normalization" model of fixed size, the best way to predict the average of all possible parameter settings, after the training data set by weighting each of which provides a posterior probability. Sometimes this may be a pretty good approximation of simple or small models, but we find ways to use considerably less computational Bayesian gold standard of performance. Index approximate number of our proposed model…

Related Documents