Scraper example using bible.com as the source.
Steve Thielemann
60dacd1f58
Update with directions on first use.
|
há 10 meses atrás | |
|---|---|---|
| src | há 10 meses atrás | |
| .gitignore | há 10 meses atrás | |
| Cargo.lock | há 10 meses atrás | |
| Cargo.toml | há 10 meses atrás | |
| README.md | há 10 meses atrás | |
| fetch1.html | há 10 meses atrás | |
| initial.config | há 10 meses atrás |
README.md
Rust - Reqwest and Scraper example
This is an example web scraper project. It downloads and extracts the Bible from https://www.bible.com.
User-Agent
The program will update the user-agent string it uses via https://www.mozilla.org/en-US/firefox/releases/ because I can.
Using
Copy initial.config to app.config.
Make a bible directory.
Run the fetch command.
Run the verse command.