[For beginners] Why are the "weights" and "bias" of neural networks necessary?

〇 Why is the "weight" of the neural network necessary?

Twitter用.001.jpeg

[Conclusion] If you change the weight, the graph will change. ▷ If you increase the weight value, the graph of the activation function becomes steeper. ▷ If the weight value is reduced, the graph of the activation function becomes looser.

[Explanation] We have considered a simple example in which one input neuron propagates forward. I used the Sigmoid function as the activation function.

In the first calculation, the output y is a linear (straight line) graph.  ▷ y=wx+b

When the result is passed through the activation function, it becomes a non-linear (squishy line) graph.  ▷ y'=1/(1+(-y))

You can see that the shape of the graph changes as you change the weight value.

3FAB52D9-CB24-4667-B66D-D751E4AA4235.jpeg

〇 Why is the "bias" of the neural network necessary?

Twitter用.002.jpeg

[Conclusion] If you change the bias, the graph will change. ▷ If you increase the bias value, the graph of the activation function will translate to the right (plus). ▷ When the bias value is reduced, the activation function graph translates to the left (minus) direction. IMG_0485.jpeg

Summary

You can freely change the shape of the graph by changing the values of weight and bias (and parameters).

Machine learning does this automatically and brings it closer to the ideal graph.

Learn more about artificial intelligence / AI / machine learning

Youtube宣伝画像.jpeg

** "AI for cat allergies" ** https://t.co/4ltE8gzBVv?amp=1

We publish about machine learning on YouTube. If you have time, please take a look.

Recommended Posts

[For beginners] Why are the "weights" and "bias" of neural networks necessary?
What are the "pipeline" and "{...}" in the Jenkins Pipeline pipeline {...} (for Groovy beginners, for experienced languages)
Guidelines for Output Layer Design of Neural Networks
[For beginners] Quantify the similarity of sentences with TF-IDF
Generalized linear model (GLM) and neural network are the same (1)
Generalized linear model (GLM) and neural network are the same (2)
Pandas basics for beginners ④ Handling of date and time items
[Python] The biggest weakness / disadvantage of Google Colaboratory [For beginners]
Overview of Docker (for beginners)
Seaborn basics for beginners ① Aggregate graph of the number of data (Countplot)
Verification of the theory that "Python and Swift are quite similar"
[For beginners] Summary of suffering from kaggle's EDA and its struggle
[Comparison of PHP, Ruby, and Python description] For those who are wondering how the description method is different.