I was addicted to scraping with Selenium (+ Python) in 2020

iframe Symptom: "The button is displayed on the execution screen, but Element is not found!"

→ Cause and solution: You cannot find the element unless you switch the iframe one by one.

driver.switch_to.frame(driver.find_elements_by_tag_name("iframe")[0])
driver.find_element_by_css_selector("#hogefuga").click()
driver.switch_to.default_content()

Interference with popups

Symptom: I can get the element of the button, but I can't press it. Error text:

Element <a class="hoge" href="/fuga">...</a> is not clickable at point (748, 591). Other element would receive the click: <div class="piyo">...</div>

→ Cause and solution: Click Body etc. once

driver.find_element_by_tag_name("body").click()

Recommended Posts

I was addicted to scraping with Selenium (+ Python) in 2020
Scraping with selenium in Python
Scraping with Selenium in Python
What I was addicted to with json.dumps in Python base64 encoding
Scraping with Selenium in Python (Basic)
What I was addicted to Python autorun
Scraping with Selenium [Python]
I was addicted to confusing class variables and instance variables in Python
I tried to log in to twitter automatically with selenium (RPA, scraping)
I was able to recurse in Python: lambda
Log in to Yahoo Business with Selenium Python
Scraping with Selenium + Python Part 1
Scraping with chromedriver in python
I was addicted to creating a Python venv environment with VS Code
Use Python from Java with Jython. I was also addicted to it.
Scraping with Tor in Python
The file name was bad in Python and I was addicted to import
Scraping with Selenium + Python Part 2
I tried scraping with python
I want to work with a robot in python.
I was able to repeat it in Python: lambda
I was addicted to trying logging.getLogger in Flask 1.1.x
What I was addicted to when using Python tornado
Summary of points I was addicted to running Selenium on AWS Lambda (python)
A note I was addicted to when running Python with Visual Studio Code
A story that I was addicted to when I made SFTP communication with python
Scraping with Python, Selenium and Chromedriver
I tried web scraping with python.
I want to debug with Python
I was addicted to multiprocessing + psycopg2
[IOS] GIF animation with Pythonista3. I was addicted to it.
I want to automatically attend online classes with Python + Selenium!
What I was addicted to when migrating Processing users to Python
[Fixed] I was addicted to alphanumeric judgment of Python strings
I was soberly addicted to calling awscli from a Python 2.7 script registered in crontab
I tried to implement PLSA in Python
Scraping with selenium ~ 2 ~
Scraping with Python
Try logging in to qiita with Python
I tried to implement permutation in Python
Scraping with Python
I want to solve APG4b with Python (only 4.01 and 4.04 in Chapter 4)
I tried scraping Yahoo News with Python
What I was addicted to when introducing ALE to Vim for Python
I tried to implement PLSA in Python 2
I was addicted to pip install mysqlclient
I wanted to solve ABC160 with Python
Scraping with Selenium
What I was addicted to when dealing with huge files in a Linux 32bit environment
I want to analyze logs with Python
I was addicted to Flask on dotCloud
I want to play with aws with python
I tried to make a periodical process with Selenium and Python
I tried to implement ADALINE in Python
A note I was addicted to when creating a table with SQLAlchemy
I wanted to solve ABC159 in Python
I tried to implement PPO in Python
[Part1] Scraping with Python → Organize to csv!
Practice web scraping with Python and Selenium
To work with timestamp stations in Python
I wanted to solve ABC172 with Python