Etusivu Tutki Apua
Kirjaudu sisään
stevet
/
rust-scraper1
1
0
Fork 0
Tiedostot Ongelmat 0 Pull-pyynnöt 0 Wiki

Scraper example using bible.com as the source.

Puu: 60dacd1f58
Haarat Tagit
rust-scraper1
ZIP TAR.GZ
Steve Thielemann 60dacd1f58 Update with directions on first use. 1 kuukausi sitten
src 247e61fc48 Added readme for gogs. 1 kuukausi sitten
.gitignore f6790cbbbc Making a single request to httpbin.org. 2 kuukautta sitten
Cargo.lock 507c90360f Added user agent updater. 1 kuukausi sitten
Cargo.toml 507c90360f Added user agent updater. 1 kuukausi sitten
README.md 60dacd1f58 Update with directions on first use. 1 kuukausi sitten
fetch1.html 060db0ff68 Initial working parser for verses. 2 kuukautta sitten
initial.config 507c90360f Added user agent updater. 1 kuukausi sitten

README.md

Rust - Reqwest and Scraper example

This is an example web scraper project. It downloads and extracts the Bible from https://www.bible.com.

User-Agent

The program will update the user-agent string it uses via https://www.mozilla.org/en-US/firefox/releases/ because I can.

Using

Copy initial.config to app.config.
Make a bible directory. Run the fetch command. Run the verse command.