No Description

Michael Ekstrand cd857028a7
no jekyll
f1083188ce
fix url
1 year ago
b48775fa84
Revert "Deploy to Netlify"
4 months ago
6bc65ecadd
Export titles
4 months ago
0ce8407694
update dvc
4 months ago
cd857028a7
no jekyll
4 months ago
8da85ee8ff
working exports
4 months ago
0ce8407694
update dvc
4 months ago
8da85ee8ff
working exports
4 months ago
0ce8407694
update dvc
4 months ago
0ce8407694
update dvc
4 months ago
8da85ee8ff
working exports
4 months ago
src
c3fb2d09d7
small warning fix
8 months ago
0ffc7b5cc2
Add Windows command support
1 year ago
0ffc7b5cc2
Add Windows command support
1 year ago
586ebc0e9f
use sphinx to buil docs
4 months ago
8fa6ec587e
Use happylog from crates
9 months ago
8fa6ec587e
Use happylog from crates
9 months ago
e67aa5e364
Cluster statistics and exploration
1 year ago
e67aa5e364
Cluster statistics and exploration
1 year ago
d929779cfb
Add license
2 years ago
b6fa88eee5
citation update
4 months ago
586ebc0e9f
use sphinx to buil docs
4 months ago
586ebc0e9f
use sphinx to buil docs
4 months ago
0ffc7b5cc2
Add Windows command support
1 year ago
0ce8407694
update dvc
4 months ago
0ce8407694
update dvc
4 months ago
8da85ee8ff
working exports
4 months ago
baaae933e6
simplify + goodreads import
2 years ago
c54eca1a4e
Add Rust-based ISBN-parsing logic
1 year ago
Data Pipeline
Legend
DVC Managed File
Git Managed File
Metric
Stage File
External File

README.md

This repository contains the code to import and integrate the book and rating data that we work with. It imports and integrates data from several sources in a single PostgreSQL database; import scripts are primarily in Python, with Rust code for high-throughput processing of raw data files.

If you use these scripts in any published research, cite our paper (PDF):

Michael D. Ekstrand and Daniel Kluver. 2021. Exploring Author Gender in Book Rating and Recommendation. User Modeling and User-Adapted Interaction (February 2021) DOI:10.1007/s11257-020-09284-2.

We also ask that you contact Michael Ekstrand to let us know about your use of the data, so we can include your paper in our list of relying publications.

Note: the limitations section of the paper contains important information about the limitations of the data these scripts compile. Do not use the gender information in this data data or tools without understanding those limitations. In particular, VIAF's gender information is incomplete and, in a number of cases, incorrect.

In addition, several of the data sets integrated by this project come from other sources with their own publications. If you use any of the rating or interaction data, cite the appropriate original source paper. For each data set below, we have provided a link to the page that describes the data and its appropriate citation.

See the documentation site for details on using and extending these tools.

Running Everything

You can run the entire import process with:

dvc repro

Copyright and Acknowledgements

Copyright © 2020 Boise State University. Distributed under the MIT License; see LICENSE.md. This material is based upon work supported by the National Science Foundation under Grant No. IIS 17-51278. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.