A scene where GPU is useful for deep learning?

I understand that GPU is effective for parallel computing by dividing mini batches at the training stage of deep learning. Q1: At the training stage, is there a scene where GPUs, especially multiple GPUs, are used other than dividing the subbatch?

Q2: Is GPU useful even in the test stage?

Thanking you in advance

Recommended Posts

A scene where GPU is useful for deep learning?
A scene where GPU is useful for deep learning?
Until the Deep Learning environment (TensorFlow) using GPU is prepared for Ubuntu 14.04
I installed Chainer, a framework for deep learning
Deep Learning Gaiden ~ GPU Programming ~
Deep learning for compound formation?
(Now) Build a GPU Deep Learning environment with GeForce GTX 960
A story about a 40-year-old engineer manager passing "Deep Learning for ENGINEER"
I don't have a GPU, but I'll try deep learning
Python-dotfiles is useful for managing dotfiles
I searched for a similar card of Hearthstone with Deep Learning
Deep learning to start without GPU
Summary of pages useful for studying the deep learning framework Chainer
[AI] Deep Learning for Image Denoising
Quickly build a python environment for deep learning and data science (Windows)
[Windows] A library where you can try Deep Learning immediately Keras course-Part 2
Why Python is chosen for machine learning
Make your own PC for deep learning
Watchdog is quite useful for file monitoring
Zope.interface is useful for practicing Hexagonal Architecture
[Deep learning] Nogizaka face detection ~ For beginners ~
About data expansion processing for deep learning
Creating a development environment for machine learning
Introduction to Deep Learning (1) --Chainer is explained in an easy-to-understand manner for beginners-
"Minecraft where a heckler flies" Generate appropriate text with Deep Learning ~ Move with mod ~
[For beginners] After all, what is written in Deep Learning made from scratch?
Deep Learning
I made a useful tool for Digital Ocean
Recommended study order for machine learning / deep learning beginners
Is there a good sample code for nosetests?
A memorandum of studying and implementing deep learning
Read & implement Deep Residual Learning for Image Recognition
PDF files and sites useful for learning Python 3
Implementation of Deep Learning model for image recognition
Python's itertools is a little useful to know
Overview and useful features of scikit-learn that can also be used for deep learning