Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
General:  academic Type:  dataset Data Domain:  nlp Integration:  dvc git github
Michael Ekstrand f571dd9e2d
Fix GH deployment
3 years ago
f1083188ce
fix url
4 years ago
f571dd9e2d
Fix GH deployment
3 years ago
6bc65ecadd
Export titles
3 years ago
0ce8407694
update dvc
3 years ago
3 years ago
8da85ee8ff
working exports
3 years ago
0ce8407694
update dvc
3 years ago
8da85ee8ff
working exports
3 years ago
0ce8407694
update dvc
3 years ago
0ce8407694
update dvc
3 years ago
8da85ee8ff
working exports
3 years ago
src
c3fb2d09d7
small warning fix
3 years ago
0ffc7b5cc2
Add Windows command support
4 years ago
0ffc7b5cc2
Add Windows command support
4 years ago
41d4bc233c
Re-run LOC MDS extract
4 years ago
8fa6ec587e
Use happylog from crates
3 years ago
8fa6ec587e
Use happylog from crates
3 years ago
e67aa5e364
Cluster statistics and exploration
4 years ago
e67aa5e364
Cluster statistics and exploration
4 years ago
d929779cfb
Add license
5 years ago
b6fa88eee5
citation update
3 years ago
0ffc7b5cc2
Add Windows command support
4 years ago
0ce8407694
update dvc
3 years ago
0ce8407694
update dvc
3 years ago
8da85ee8ff
working exports
3 years ago
baaae933e6
simplify + goodreads import
5 years ago
c54eca1a4e
Add Rust-based ISBN-parsing logic
4 years ago
Storage Buckets
Data Pipeline
Legend
DVC Managed File
Git Managed File
Metric
Stage File
External File

README.md

You have to be logged in to leave a comment. Sign In

This repository contains the code to import and integrate the book and rating data that we work with. It imports and integrates data from several sources in a single PostgreSQL database; import scripts are primarily in Python, with Rust code for high-throughput processing of raw data files.

If you use these scripts in any published research, cite our paper (PDF):

Michael D. Ekstrand and Daniel Kluver. 2021. Exploring Author Gender in Book Rating and Recommendation. User Modeling and User-Adapted Interaction (February 2021) DOI:10.1007/s11257-020-09284-2.

We also ask that you contact Michael Ekstrand to let us know about your use of the data, so we can include your paper in our list of relying publications.

Note: the limitations section of the paper contains important information about the limitations of the data these scripts compile. Do not use the gender information in this data data or tools without understanding those limitations. In particular, VIAF's gender information is incomplete and, in a number of cases, incorrect.

In addition, several of the data sets integrated by this project come from other sources with their own publications. If you use any of the rating or interaction data, cite the appropriate original source paper. For each data set below, we have provided a link to the page that describes the data and its appropriate citation.

See the documentation site for details on using and extending these tools.

Running Everything

You can run the entire import process with:

dvc repro

Copyright © 2020 Boise State University. Distributed under the MIT License; see LICENSE.md. This material is based upon work supported by the National Science Foundation under Grant No. IIS 17-51278. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

Tip!

Press p or to see the previous file or, n or to see the next file

About

This repository contains the code to import and integrate the book and rating data that we work with. It imports and integrates data from several sources in a homogenous tabular outputs; import scripts are primarily Rust, with Python implement analyses.

Collaborators 1

Comments

Loading...