How to use machine learning for work? 01_ Understand the purpose of machine learning

Hello everyone. I started Qiita from today.

As a machine learning engineer, I am usually involved in AI development and web application development.

In my private life, I became a new dad. I am writing an article while holding my eldest son who is 4 months old (laughs)

As a motivation for writing articles, I have been working on machine learning since 2017 when there was no reference book yet, I feel that the experience of learning machine learning through hard work is definitely useful for someone.

Therefore, I decided to write an article that can support people who are aiming for career advancement. The theme of the memorable first post was "** What was machine learning made for?" **"is.

No matter how good a reference book you read, you can't learn anything unless you know the purpose of machine learning. First, let's understand the big picture that is the basis of everything.

We also send various information on SNS, so if you feel good reading the article I would be grateful if you could follow Twitter account "Saku731".

What is machine learning?

I think everyone has had such a hard time.

** "I don't know what I learned from machine learning" ** ** "Logistic regression, decision tree, support vector machine, there are too many methods" **

One of the pain points in learning machine learning is ** many techniques to remember **. It is necessary to understand 5 to 10 methods just by reading one reference book.

What's more, ** "when" and "how" to use those methods properly **? I have never come across a well-explained reference book.

Then, on the contrary, why not understand from ** why there are various methods ** and their ** commonalities **? That way you can get a faster overview of machine learning.

A purpose common to all machine learning. It means making a ** good model **.

image02.png

As you can see in the figure, this is all about machine learning. "** Give a large amount of data to a computer and find out the rules for making predictions **"

However, there are various types of data in the world.

--CSV (Excel): Sales data, customer data --Image: Photos posted on Instagram, images from surveillance cameras --Voice: Meeting voice memo, call center call recording

Machine learning engineers are required to create good models (highly accurate predictions) of any data. Various methods are prepared as a tool box for that purpose.

--Sales data ⇒ Regression (multiple regression, regression tree, etc.) --Instagram photo ⇒ CNN-based method (VGG16, LesNet, etc.) --Voice memo ⇒ Time series analysis (RNN, LSTM, etc.)

In the case of cooking, the common purpose is "** to make delicious food **". For that purpose, it is the same as using the appropriate ** recipe (= method) ** according to the ** material (= data) **.

Organizing terms related to machine learning

Now that you can see the purpose of machine learning, let's broaden our horizons a little more.

As the first struggling part of machine learning ** AI / Machine Learning / Deep Learning ** I get the impression that many people do not understand these differences.

If you read the news and articles of 2018 when AI (machine learning) became popular, about these three I remember that there were many sentences that made me feel, "Isn't the person who wrote it understand too much?"

If you don't understand the difference here, even if you study hard This is an important issue because it is not systematically organized as usable knowledge.

First of all, the three terms ** AI / machine learning / deep learning ** have a comprehensive relationship as shown in the figure.

image01.jpg

(Source: https://www.shikaku-square.com/media/ai-license/001-how-to-study-deep-learning-for-general/)

As you can see, it is a comprehensive relationship of "AI > Machine learning > Deep learning". It is as follows when organized in words.

By valuing such basic knowledge, you can deepen your understanding of articles and reference books at once. Also, when it comes to machine learning projects, it becomes a knowledge that even non-programmers should know.

at the end

Next time, after organizing the ** AI development project overview ** I will write ** "where" and "how" ** where machine learning is used.

If you have studied machine learning, you may have heard of it. ** Each topic such as "pre-processing" "learning" "tuning" "verification" ** It will be organized in association with the progress of the AI development project.

In the next article, it will be based on the programming language ** Python ** We will organize specific study methods, so please look forward to it.

Thank you for reading for me until the end.

【P.S.】 We also send various information on SNS, so if you feel good reading the article I would be grateful if you could follow Twitter account "Saku731".

~~ Also, at the end of the sentence, we are doing "** Team Development Experience Project **" for a limited time. ~~ ~~ If you are interested, please check [Application Sheet] for details. ~~ (Addition) The deadline has been closed because it is full. The next time is scheduled for March 2019, so if you would like to be informed, please fill in [Reservation Form].

Recommended Posts

How to use machine learning for work? 01_ Understand the purpose of machine learning
How to use machine learning for work? 02_Overview of AI development project
How to use machine learning for work? 03_Python coding procedure
How to increase the number of machine learning dataset images
Introduction to Machine Learning: How Models Work
Record the steps to understand machine learning
How to use MkDocs for the first time
Create a dataset of images to use for learning
Understand how to use django-filter
How to use the generator
How to use the decorator
The first step of machine learning ~ For those who want to implement with python ~
Try to evaluate the performance of machine learning / regression model
Survey on the use of machine learning in real services
Made icrawler easier to use for machine learning data collection
Try to evaluate the performance of machine learning / classification model
I didn't know how to use the [python] for statement
[Machine learning] I tried to summarize the theory of Adaboost
How to use the zip function
How to use the optparse module
Summary of how to use pandas.DataFrame.loc
Summary of how to use pyenv-virtualenv
Summary of how to use csvkit
How to use the ConfigParser module
How to collect machine learning data
[Deep learning] Investigating how to use each function of the convolutional neural network [DW day 3]
How to change the log level of Azure SDK for Python
[Machine learning] Understand from mathematics why the correlation coefficient ranges from -1 to 1.
Before the introduction to machine learning. ~ Technology required for machine learning other than machine learning ~
[Introduction to Python] How to use the in operator in a for statement?
How to use Jupyter on the front end of supercomputer ITO
People memorize learned knowledge in the brain, how to memorize learned knowledge in machine learning
[Python] Summary of how to use pandas
How to use the Spark ML pipeline
How to check the version of Django
I tried to understand supervised learning of machine learning in an easy-to-understand manner even for server engineers 1
An introduction to OpenCV for machine learning
[Linux] How to use the echo command
How to calculate Use% of df command
How to use the Linux grep command
[Python] Organizing how to use for statements
[Python2.7] Summary of how to use unittest
How to use Pylint for PyQt5 apps
Jupyter Notebook Basics of how to use
How to enjoy Coursera / Machine Learning (Week 10)
How to use "deque" for Python data
Basics of PyTorch (1) -How to use Tensor-
[Python] Understand how to use recursive functions
An introduction to Python for machine learning
How to use the IPython debugger (ipdb)
Summary of how to use Python list
[Python2.7] Summary of how to use subprocess
I tried to understand supervised learning of machine learning in an easy-to-understand manner even for server engineers 2
[Python] How to use the for statement. A method of extracting by specifying a range or conditions.
How to use fingerprint authentication for KDE
[Question] How to use plot_surface of python
How to study for the Deep Learning Association G test (for beginners) [2020 version]
From the introduction of GoogleCloudPlatform Natural Language API to how to use it
Search for technical blogs by machine learning focusing on "easiness to understand"
Python learning memo for machine learning by Chainer until the end of Chapter 2
100 language processing knocks for those who do not understand the meaning of problem sentences Chapter 8 Machine learning