The source code is posted on Github
The other day, I released a site called "HonBa ~ Book Search ~", so let's look back on the site production and find improvements! Yeah! Something (?)
.python (beautifulSoup4 selenium)
. TypeScript
・ HTML
・ SCSS
Scraping information with python, exporting with CSV
↓
Arrange CSV data with TypeScript and generate a table
TypeScript
TypeScript was convenient after all. However, to be honest, I wondered if I wouldn't force myself to use it for personal development of this scale.
When you want to use TypeScript I found some articles that said, "If you add a mold to the JS that you have already made, it's OK!"
the property ‘hoge' does not exist on value of type 'htmlelement'
For details, this article was easy to understand. https://qiita.com/Sekky0905/items/a88721f2af41050c93f2
SCSS This was extremely convenient. I want to continue using it from now on. The main points that I found useful were ・ Programming language-like block description is possible
-You can import another file and output it as one CSS.
It is two points. When importing another file, it was convenient to make Header and Footer another file.
To be honest, scraping python took the most time, but it was a lot of fun. After all it is fun to develop something
As an improvement point ・ I got it in CSV, but should I use it as a DB (please tell me the details)
・ I think it would be even better if we created a function to delay notifications in Slack, LINE, etc.
・ I want to automatically schedule scraping in Python.
I think these three.