Bookdata-tools/docs/using/sources.md

title	parent	nav_order
Source Data	Usage	3

Downloading Source Data

These import tools will integrate several data sets. Some of them are auto-downloaded, but others you will need to download yourself and save in the data directory. The data sources are:

• Library of Congress MDSConnect Open MARC Records (auto-downloaded).
• LoC MDSConnect Name Authorities (auto-downloaded).
• Virtual Internet Authority File MARC 21 XML data (not auto-downloaded).
• OpenLibrary Dump (auto-downloaded).
• Amazon Ratings 'ratings only' data for Books (not auto-downloaded — save CSV file in data). If you use this data, cite the paper on that site.
• BookCrossing (auto-downloaded). If you use this data, cite the paper on that site.
• GoodReads data from UCSD Book Graph — the GoodReads books, works, authors, and full interaction files (not auto-downloaded - save GZip'd JSON files in data). If you use this data, cite the paper on that site.

If all files are properly downloaded, ./dvc.sh status data/*.dvc will show that all files are up to date, except for loc-listings.dvc which is 'always changed' (it may also display warnings about locked files).

$ ./dvc.sh status data/*.dvc
data/loc-listings.dvc:
        always changed
$

See Data Model for details on how each data source appears in the final data.