[EC2] How to run selenium webdriver

Unlike local, you need to run chrome in a headless browser.

What is a headless browser?

-Process on the back side without launching a visible browser. ・ In the case of chrome, it is called headless chrome.

Description for EC2

`python`


from selenium import webdriver

#Import Options class (for headless settings)
from selenium.webdriver.chrome.options import Options

#Create an instance of Options (stored in the variable options)
options = Options()

#Set headless to True
options.headless = True

#Start webdriver
driver = webdriver.Chrome(options=options)

#Open the specified URL
driver.get("URL")

#Describe the process to be executed below
processing

The headless browser can be launched and the process can be executed.

Check the contents

Options class

・ Selenium.webdriver.chrome.options.Options └ Options class location └ Options class in options module in chrome module in webdriver module in selenium module

・ From selenium.webdriver.chrome.options import Options └ Import Options class └ Call after import is possible with Options

Reference link ・ Explanation of Options-Official Site About importing classes

It is interesting because you can see the contents of the method on the above official website.

.headless method

options.headless = True -Set the value of the argument "headless" to True. -The headless method itself returns whether headless is set as an argument.

Other headless setting methods

You can also set headless using the ** add_argument method **.

options.add_argument('--headless') └ Set "'--headless'" with the argument.

webdriver.Chrome(options=options) -A function that starts the webdriver. -Set startup options with arguments. -Default options = none is set for the created instance. (I'm not confident, please let me know if anyone is familiar with it)

## Supplement ### ① Extract and display the text on the upper left from the google top page.

`python`


from selenium import webdriver
from selenium.webdriver.chrome.options import Options

options = Options()
options.headless = True

driver = webdriver.Chrome(options=options)

driver.get("https://www.google.co.jp/")

element_text = driver.find_element_by_id("hptl").text
print(element_text)

"About Google Store" is displayed.

### (2) Description when starting locally ``` from selenium import webdriver driver = webdriver.Chrome('chromedriver.exe')

driver.get('url')


 ** ▼ Difference from headless **
 -There is no headless setting.
 -The argument when starting webdriver is chromedriver.exe
 -"Chromedriver.exe" must be in the same hierarchy.
 └ In case of another layer, specify the path as an argument.



<br>
 There is a difference from the execution method in the local environment, but you can use it without problems as long as you make the initial settings.