I tried my best to make an optimization function, but it didn't work.

reference

https://qiita.com/tokkuman/items/1944c00415d129ca0ee9

Execution source

https://github.com/akidukin/optimize_test/blob/master/benchmark_optimizer.py

Target

--Self-satisfaction

What did you do ??

Based on the URL that I referred to

In this article (https://qiita.com/Akidukin14/items/4cf3fd1a065726450e4d) --sphere function --losenbrock function --styblinskitang function I wanted to see how it works by applying it to

Since I solved each partial differential formula myself, it may be bad.

result

sphere_optim.png losenbrock_optim.pngstyblinskitang_optim.png

Summary

Momentum SGD is especially terrible, where are all? I'm tired so I thought it was okay

Recommended Posts

I tried my best to make an optimization function, but it didn't work.
I tried to install Docker on Windows 10 Home but it didn't work
I tried to use Java with Termux using Termux Arch but it didn't work
[I'm an IT beginner] I tried my best to implement Linux on Windows
I tried my best to return to Lasso
I tried to make an image similarity function with Python + OpenCV
I installed PySide2, but pyside2-uic didn't work, so I managed to do it.
When I tried to make a VPC with AWS CDK but couldn't make it
When I tried to create a virtual environment with Python, it didn't work
I tried to use Twitter Scraper on AWS Lambda and it didn't work.
I tried to make an OCR application with PySimpleGUI
I tried to make an air lip detection & automatic response BOT for remote work
When I tried to create a project using Python on Docker with PyCharm, it didn't work, but it worked with Docker Compose.
I tried to make an activity that collectively sets location information
[Python] Simple Japanese ⇒ I tried to make an English translation tool
I tried to make it possible to automatically send an email just by double-clicking the [Python] icon
Gorilla judgment machine, gorilla! !! Tried to make it!
I tried to make an open / close sensor (Twitter cooperation) with TWE-Lite-2525A
I tried to make a calculator with Tkinter so I will write it
I want to make an automation program!
I tried to make a Web API
I tried to make it possible to automatically send an email just by double-clicking the [GAS / Python] icon
[Zaif] I tried to make it easy to trade virtual currencies with Python
I tried to publish my own module so that I can pip install it
I tried to make my own source code compatible with Chainer v2 alpha
I made an image classification model and tried to move it on mobile
Load a photo and make a handwritten sketch. With zoom function. Tried to make it.
I tried to make a dictionary function that does not distinguish between cases
Docker x visualization didn't work and I was addicted to it, so I summarized it!
I didn't understand the Resize of TensorFlow so I tried to summarize it visually.
I tried to get an image by scraping
I want to make fits from my head
I tried to make AI for Smash Bros.
I tried to detect an object with M2Det!
I tried to make a ○ ✕ game using TensorFlow
I tried to make an automatic character dialogue generator by N floor Markov chain
I tried to scrape YouTube, but I can use the API, so don't do it.
I tried to make a memo app that can be pomodoro, but a reflection record
"Amazon Dash Button" has landed in Japan, but I dared to make it myself
I tried to make it easy to change the setting of authenticated Proxy on Jupyter
I tried to learn the sin function with chainer
I tried to make a "fucking big literary converter"
Continuation ・ I tried to make Slackbot after studying Python3
I tried to implement an artificial perceptron with python
I tried to get an AMI using AWS Lambda
I tried to approximate the sin function using chainer
I tried to summarize four neural network optimization methods
I tried to step through Bayesian optimization. (With examples)
I tried to find an alternating series with tensorflow
I introduced black to vscode, but it doesn't autoformat
[Python] I tried to make an application that calculates salary according to working hours with tkinter
I tried it with SymPyLive by referring to "[Ruby] Getting unique elements from an array".
I want to see something beautiful, so I tried to visualize the function used for benchmarking the optimization function.
[Git] I tried to make it easier to understand how to use git stash using a concrete example
I tried to debug.
I tried to paste
I tried Bayesian optimization!
I tried to make various "dummy data" with Python faker
When I try to push with heroku, it doesn't work
I tried to simulate ad optimization using the bandit algorithm.
Ubuntu blew up when I tried to change my username