Etusivu Tutki Apua
Kirjaudu sisään
stevet
/
rust-scraper1
1
0
Fork 0
Tiedostot Ongelmat 0 Pull-pyynnöt 0 Wiki

Scraper example using bible.com as the source.

Puu: 60dacd1f58
Haarat Tagit
rust-scraper1
ZIP TAR.GZ
Steve Thielemann 60dacd1f58 Update with directions on first use. 11 kuukautta sitten
src 247e61fc48 Added readme for gogs. 11 kuukautta sitten
.gitignore f6790cbbbc Making a single request to httpbin.org. 11 kuukautta sitten
Cargo.lock 507c90360f Added user agent updater. 11 kuukautta sitten
Cargo.toml 507c90360f Added user agent updater. 11 kuukautta sitten
README.md 60dacd1f58 Update with directions on first use. 11 kuukautta sitten
fetch1.html 060db0ff68 Initial working parser for verses. 11 kuukautta sitten
initial.config 507c90360f Added user agent updater. 11 kuukautta sitten

README.md

Rust - Reqwest and Scraper example

This is an example web scraper project. It downloads and extracts the Bible from https://www.bible.com.

User-Agent

The program will update the user-agent string it uses via https://www.mozilla.org/en-US/firefox/releases/ because I can.

Using

Copy initial.config to app.config.
Make a bible directory. Run the fetch command. Run the verse command.