Machine learning ① SVM (Support Vector Machine) Summary

Summary of Support Vector Machine

What is SVM ?

In a nutshell, SVM is a supervised machine learning model that draws a line that divides data into two. There are priorities at this time.

  1. Accurately group the data. (Except for outliers)
  2. Maximize the Margin, which is the difference between the line and the point.

default code

python



from sklearn.svm import SVC

SVC(C=1.0, kernel='rbf', degree=3, gamma='auto', coef0=0.0, shrinking=True, 
probability=False, tol=0.001, cache_size=200, class_weight=None, 
verbose=False, max_iter=-1, decision_function_shape=None, random_state=None)

Description of Parameter in SVM

C is a parameter that determines how much misclassification is tolerated. The higher the value of C, the more accurate the classification of the data will be. That is, it tends to be a more complicated line. Note that if you make it too large, you will be in a state of overfitting.

Screen Shot 2017-05-08 at 13.26.27.png According to the 'Introduction to Machine Learning' from Udacity

Screen Shot 2017-05-08 at 13.31.00.png According to the 'Introduction to Machine Learning' from Udacity

On the other hand, if you make it smaller, the margin with a distant point becomes more important, so the line becomes simpler to some extent.

Screen Shot 2017-05-08 at 13.32.35.png According to the 'Introduction to Machine Learning' from Udacity

The pros and cons of SVM.

--Bad point If the data contains noise (in the figure above, a small number of circles are in the area of circles, or a small number of circles are in the area of circles), and the data is over. If it is wrapped (in the above figure, the line in the middle should be drawn, and many circles and crosses are mixed), it is difficult to classify the data neatly.

Summary

The above is the outline of SVM as far as I can understand. We will update it daily, so if you have something to add or fix, we would appreciate it if you could comment.

Recommended Posts

Machine learning ① SVM (Support Vector Machine) Summary
Machine learning support vector machine
Machine Learning: Supervised --Support Vector Machine
Machine learning algorithm (support vector machine)
Machine learning algorithm (support vector machine application)
<Course> Machine Learning Chapter 7: Support Vector Machine
Machine learning tutorial summary
Machine learning ⑤ AdaBoost Summary
Calculation of support vector machine (SVM) (using cvxopt)
Machine learning ② Naive Bayes Summary
Machine learning article summary (self-authored)
Machine learning ④ K-nearest neighbor Summary
Machine learning summary by Python beginners
Machine learning ③ Summary of decision tree
Machine learning
Try machine learning with scikit-learn SVM
scikit-learn How to use summary (machine learning)
[Translation] scikit-learn 0.18 User Guide 1.4. Support Vector Machine
"Python Machine Learning Programming" Summary Note (Jupyter)
Machine learning algorithm classification and implementation summary
Support Vector Machine (for beginners) -Code Edition-
Machine learning algorithm (linear regression summary & regularization)
[Memo] Machine learning
Machine learning classification
Machine Learning sample
Explaining the classic machine learning "Support Vector Machine (SVM)" so that even high school students can understand it
[Python] Easy introduction to machine learning with python (SVM)
Summary of evaluation functions used in machine learning
[Python] I thoroughly explained the theory and implementation of support vector machine (SVM)
About machine learning overfitting
[Python] Sort apples and pears from pixel values using a support vector machine (SVM)
Machine Learning: Supervised --AdaBoost
Machine learning logistic regression
Machine learning python code summary (updated from time to time)
[Machine learning] Understanding SVM from both scikit-learn and mathematics
Studying Machine Learning ~ matplotlib ~
Machine learning linear regression
Machine learning course memo
Machine learning library dlib
Machine learning (TensorFlow) + Lotto 6
Site summary to learn machine learning with English video
Somehow learn machine learning
Summary of the basic flow of machine learning with Python
Summary for learning RAPIDS
Machine learning library Shogun
Machine learning rabbit challenge
Introduction to machine learning
Machine Learning: k-Nearest Neighbors
What is machine learning?
Python Machine Learning Programming Chapter 2 Classification Problems-Machine Learning Algorithm Training Summary
Site summary where you can learn machine learning for free
A beginner's summary of Python machine learning is super concise.
Support Kaggle / MNIST Do your best with a vector machine
Machine learning model considering maintainability
Machine learning learned with Pokemon
Data set for machine learning
Japanese preprocessing for machine learning
An introduction to machine learning
Machine learning / classification related techniques
Machine Learning: Supervised --Linear Regression
Ensemble learning summary! !! (With implementation)