Try scraping using java [Notes]

What I tried

Obtained IT articles from Yahoo News.

Note writing

jdk14.0.1 jsoup-1.13.1.jar

Since the environment setting of vscode was not completed, jsoup was not loaded at first and an error occurred. Correspond by setting in the following file.


    "java.project.referencedLibraries": [


package demojava.demo3;
import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;

public class Web {
	public static void main(String[] args) throws IOException {
		Document document = Jsoup.connect("").get();
		Elements courses =".newsFeed_item_link");
		for (Element course : courses) {
			System.out.println(course.attr("href")+ " [[::]] " + course.text());

Acquisition result


Recommended Posts

Try scraping using java [Notes]
Scraping practice using Java ②
Scraping practice using Java ①
Try using RocksDB in Java
java notes
Try using Redis with Java (jar)
[Java] Try to implement using generics
Try using IBM Java method tracing
Try using Hyperledger Iroha's Java SDK
[Java] Where did you try using java?
Try using libGDX
Try using powermock-mockito2-2.0.2
Try using GraalVM
Java Generics (Notes)
Try using the Stream API in Java
Try Java 8 Stream
Try using jmockit 1.48
Try using sql-migrate
Notes on operators using Java ~ String type ~
[Java] Array notes
Study Java Try using Scanner or Map
Try using JSON format API in Java
Try using SwiftLint
Try using Log4j 2.0
[Java] Study notes
Java serialization notes
Try using JobScheduler's REST-API --Java RestClient implementation--
Roughly try Java 9
Try using the Wii remote with Java
Try using Firebase Cloud Functions on Android (Java)
Try using JobScheduler's REST-API --Java RestClient Test class-
Try scraping about 30 lines in Java (CSV output)
Try using Sourcetrail (win version) in Java code
Try using GCP's Cloud Vision API in Java
Try using Sourcetrail (macOS version) in Java code
Try similar search of Image Search using Java SDK [Search]
Try accessing the dataset from Java using JZOS
Try communication using gRPC on Android + Java server
Try using the COTOHA API parsing in Java
Try using Axon Framework
Sorting using java comparator
[Java] Stream Collectors notes
Try using JobScheduler's REST-API
Java formatted output [Notes]
Try using java.lang.Math methods
Try using PowerMock's WhiteBox
[Java] Control syntax notes
Try using Talend Part 2
Java NIO 2 review notes
Try using Talend Part 1
Try using F # list
[Java] Basic method notes
Try using each_with_index method
Try Java return value
Try using Spring JDBC
Try implementing the Eratosthenes sieve using the Java standard library
Try Image Search's similar search using Java SDK [Registration]
Try image classification using TensorFlow Lite on Android (JAVA)
Try global hooking in Java using the JNativeHook library
Try to build a Java development environment using Docker
I tried scraping a stock chart using Java (Jsoup)