The Java Web Scraping Handbook

A step by step guide to web scraping

Web scraping or crawling is the art of fetching data from a third party website by downloading and parsing the HTML code to extract the data you want. It can be hard. From bad HTML code to heavy Javascript use and anti-bot techniques, it is often tricky.

Lots of companies use it to obtain knowledge concerning competitor prices, news aggregation, lead generation...

This book will teach you how to extract data from any website, how to deal with AJAX / Javascript heavy websites, break captchas, deploy your scrapers in the cloud and many other advanced techniques.

Buy now

What you will get

120+ pages eBook

This book is 120-170 pages (depending on the format) of detailed instructions, code examples, tips and exercises

Source code included

You will have full access to the source code of each chapter with the standard and premium package

Exercises

You will have access to a sandbox website (standard and premium package) to test your knowledge and apply the techniques you learned.

Table of Content

1. Introduction to Web Scraping

In this chapter you will learn what Web Scraping is. Who uses it, for what purpose, and the legal side.

2. Web fundamentals

You can't scrape the web before really understanding it, we will go through each important foundation of the web : HTTP protocol, and the DOM.

3. Extracting the data you want

In this chapter you will learn how to parse simple HTML, through lots of different examples

4. Handling forms

Dealing with forms can be complicated, in this chapter I will show you how to pass through login forms, or post any forms

5. Dealing with JavaScript

JavaScript heavy website can be quite complicated to deal with. In this chapter we will see how to use Chrome in headless mode to handle this task.

6. Captchas, Images Keypads and other beautiful things

Learn how to deal with captchas, sign in "Images Keypad" protected login forms and other annoying things

7. Stay under cover

In this chapter we will see how to stay undetected, how to use proxies and make our scraping bots look like Humans

8. Cloudy Scraping

Learn how to run your scrapers in the cloud,to perform large scale web scraping tasks.

Choose a package
A package for everyone

Ebook only

$29

Ebook in PDF / EPUB / MOBI
Free Updates

Complete package

$69

Ebook in PDF / EPUB / MOBI
Full source code
Access to a sandbox website
Access to a private forum to get help
Best Price Deal
Free Updates

Standard package

$49

Ebook in PDF / EPUB / MOBI
Full source code
Access to a sandbox website
Free Updates

Want to buy the book for your team ? Check the entreprise plans

About me

Hi there, I'm Kevin Sahin, the author of Java Web Scraping Handbook. I have a personnal blog where I write about Web scraping and software developement. I am also the founder of SaasFactory a company that operates several Software as a Service tools

Previously I spent more than four years building large scale web scrapers in the fintech industry, we're talking about millions of web pages scraped each day. I got my BS in computer science at Paul Sabatier University, in Toulouse, France. I wish I had a book like this when I started my job, to answer all the questions I had. Unfortunally, there wasn't a lot of good resources about web scraping back then. But now there is :)

You can find me on Facebook and Twitter