theCodingInterface

Providing quality software engineering content in the form of tutorials, applications, services, and commentary suited for developers.

Posts about Web Scraping

Building a Text Analytics App in Python with Flask, Requests, BeautifulSoup, and TextBlob

This article introduces how to build a Python and Flask based web application for performing text analytics on internet resources such as blog pages. To perform text analytics I will utilizing Requests for fetching web pages, BeautifulSoup for parsing html and extracting the viewable text and, apply the TextBlob package to calculate a few sentiment scores.

A Java Web Scraping App with Jsoup and JavaFX

The web has been an entropic explosion of data onto the world and, in recent years it has been shown that enormous value can be gleaned from even seaminly innocuous text data such as the blog post you're reading now. In this article I demonstrate how to use the Jsoup Java library to fetch and parse text data from web pages paired with simple query and display functionality wrapped in a JavaFX desktop app, named ScraperFX, running on OpenJDK 12.

theCodingInterface