Neural Network 06 (Optimization Method)

1. Optimization method After the network is built and the loss function is designed, the parameters (weights, offsets) are updated according to the loss function. The parameter update process is a neural network optimization process. 2. Gradient descent method Simply put, the gradient descent method is a method of finding a way to minimize the […]

[CNN vs traditional neural network]

Article directory 1. Overview of Neural Networks Traditional multi-layer neural network convolutional neural network 2. Core structure of CNN a. Convolutional Layer b. Pooling Layer c. Fully Connected Layer 3. How to calculate convolution 3.1. Convolutional Kernel 3.2. Calculation process of convolution operation Step 1: Sliding of convolution kernel Step 2: Element-wise multiplication Step 3: […]

P18 Neural Network Special Topic-Convolutional Layer

Read the document again inchannel input channel number outchannel number of output channels (number of convolution kernels) kernel_size convolution kernel size stride=1 convolution process path size padding Whether padding is performed during the convolution process dilation The corresponding bit distance in the convolution kernel groups group convolution is generally 1 bias bias is generally True […]

[ElM Classification] Optimizing ElM neural network based on genetic algorithm to implement data classification with matlab code

?About the author: A Matlab simulation developer who loves scientific research. He cultivates his mind and improves his technology simultaneously. For cooperation on MATLAB projects, please send a private message. Personal homepage: Matlab Research Studio Personal credo: Investigate things to gain knowledge. For more complete Matlab code and simulation customization content, click Intelligent optimization algorithm […]

Multi-input multi-output prediction of Matlab recurrent neural network RNN

?About the author: A Matlab simulation developer who loves scientific research. He cultivates his mind and improves his technology simultaneously. For cooperation on MATLAB projects, please send a private message. Personal homepage: Matlab Research Studio Personal credo: Investigate things to gain knowledge. For more Matlab complete code and simulation customization content, click Intelligent optimization algorithm […]

The ASLP Laboratory of NPU open sourced a CPPN-based neural network hot word enhanced speech recognition solution in WeNet

Contextual biasing aims to integrate contextual knowledge into speech recognition (ASR) systems to improve vocabulary in related fields (commonly known as “Hot words” ) on the recognition accuracy. In many ASR scenarios, the speech to be recognized may contain phrases that are rarely or not seen in the training data, such as some domain-specific nouns, […]

[RNN Regression Prediction] Regression prediction based on RNN recurrent neural network prediction with matlab code

?About the author: A Matlab simulation developer who loves scientific research. He cultivates his mind and improves his technology simultaneously. For cooperation on MATLAB projects, please send a private message. Personal homepage: Matlab Research Studio Personal credo: Investigate things to gain knowledge. For more complete Matlab code and simulation customization content, click Intelligent optimization algorithm […]

[ElM Classification] Optimizing ElM neural network based on genetic algorithm to implement data classification with matlab code

?About the author: A Matlab simulation developer who loves scientific research. He cultivates his mind and improves his technology simultaneously. For cooperation on MATLAB projects, please send a private message. Personal homepage: Matlab Research Studio Personal credo: Investigate things to gain knowledge. For more complete Matlab code and simulation customization content, click Intelligent optimization algorithm […]

[GRU Regression Prediction] Optimizing the gated cyclic unit GWO-GRU neural network based on the gray wolf algorithm to achieve multi-input single-output regression prediction with matlab code

?About the author: A Matlab simulation developer who loves scientific research. He cultivates his mind and improves his technology simultaneously. For cooperation on MATLAB projects, please send a private message. Personal homepage: Matlab Research Studio Personal credo: Investigate things to gain knowledge. For more complete Matlab code and simulation customization content, click Intelligent optimization algorithm […]

[RNN Regression Prediction] Regression prediction based on RNN recurrent neural network prediction with matlab code

?About the author: A Matlab simulation developer who loves scientific research. He cultivates his mind and improves his technology simultaneously. For cooperation on MATLAB projects, please send a private message. Personal homepage: Matlab Research Studio Personal credo: Investigate things to gain knowledge. For more complete Matlab code and simulation customization content, click Intelligent optimization algorithm […]