Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Resources  
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Explore Pricing
Product  
Data Engine LLMs Platform Enterprise
Connect to Dagshub Discord channel
Register
Login

avatar Dean
/
Bookdata-tools
mirror of https://github.com/BoiseState/bookdata-tools

Watch 2
Issues   Discussions 0 Invite collaborators

dvc.lock 3.4 KB
History Raw

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107 
  1. schema: '2.0'
    2. 

  2. stages:
    3. 

  3.   clean-ratings:
    4. 

  4.     cmd: python ../run.py bx-extract.py ../data/BX-CSV-Dump.zip cleaned-ratings.csv
    5. 

  5.     deps:
    6. 

  6.     - path: ../data/BX-CSV-Dump.zip
    7. 

  7.       md5: 37d647ee9e18ba134ea6d78ee4fe5292
    8. 

  8.       size: 26085508
    9. 

  9.     - path: bx-extract.py
    10. 

  10.       md5: d90021e31eb39ee3b3470715043d270b
    11. 

  11.       size: 1297
    12. 

  12.     outs:
    13. 

  13.     - path: cleaned-ratings.csv
    14. 

  14.       md5: da3196d4af84ae39b3713e73c59677c7
    15. 

  15.       size: 22627884
    16. 

  16.   bx-cluster-ratings:
    17. 

  17.     cmd: python ../run.py --rust fusion bx-cluster-ratings.tcl
    18. 

  18.     deps:
    19. 

  19.     - path: ../book-links/all-isbns.parquet
    20. 

  20.       md5: 56ef5f842af3651da12b632886432122
    21. 

  21.       size: 152341832
    22. 

  22.     - path: ../book-links/isbn-clusters.parquet
    23. 

  23.       md5: a492385cb01a5ec059b5035ed703307c
    24. 

  24.       size: 162226729
    25. 

  25.     - path: bx-cluster-ratings.tcl
    26. 

  26.       md5: 661af7178a042f89125c816e0c66b739
    27. 

  27.       size: 407
    28. 

  28.     - path: cleaned-ratings.csv
    29. 

  29.       md5: da3196d4af84ae39b3713e73c59677c7
    30. 

  30.       size: 22627884
    31. 

  31.     outs:
    32. 

  32.     - path: bx-cluster-ratings.parquet
    33. 

  33.       md5: 15042b137d55528192b998a0b65cf581
    34. 

  34.       size: 2818785
    35. 

  35.   bx-cluster-actions:
    36. 

  36.     cmd: python ../run.py --rust fusion bx-cluster-actions.tcl
    37. 

  37.     deps:
    38. 

  38.     - path: ../book-links/all-isbns.parquet
    39. 

  39.       md5: 56ef5f842af3651da12b632886432122
    40. 

  40.       size: 152341832
    41. 

  41.     - path: ../book-links/isbn-clusters.parquet
    42. 

  42.       md5: a492385cb01a5ec059b5035ed703307c
    43. 

  43.       size: 162226729
    44. 

  44.     - path: bx-cluster-actions.tcl
    45. 

  45.       md5: f06f2a9c19d319aa8802a15b092ac133
    46. 

  46.       size: 359
    47. 

  47.     - path: cleaned-ratings.csv
    48. 

  48.       md5: da3196d4af84ae39b3713e73c59677c7
    49. 

  49.       size: 22627884
    50. 

  50.     outs:
    51. 

  51.     - path: bx-cluster-actions.parquet
    52. 

  52.       md5: b85f1f166708fd9bc68813a09ecad094
    53. 

  53.       size: 6246167
    54. 

  54.   cluster-ratings:
    55. 

  55.     cmd: python run.py --rust cluster group-actions -s bx-ratings -o bx/bx-cluster-ratings.parquet
    56. 

  56.     deps:
    57. 

  57.     - path: book-links/isbn-clusters.parquet
    58. 

  58.       md5: 9bb3676bec6b5b3c03fe4c25701c21f4
    59. 

  59.       size: 229330723
    60. 

  60.     - path: bx/cleaned-ratings.csv
    61. 

  61.       md5: da3196d4af84ae39b3713e73c59677c7
    62. 

  62.       size: 22627884
    63. 

  63.     - path: src/cli/cluster
    64. 

  64.       md5: a1d600e4111815f34cd366be955d3f8f.dir
    65. 

  65.       size: 25891
    66. 

  66.       nfiles: 11
    67. 

  67.     outs:
    68. 

  68.     - path: bx/bx-cluster-ratings.parquet
    69. 

  69.       md5: b37f08a3f38031c23c4db5cd73a5dc7d
    70. 

  70.       size: 3043911
    71. 

  71.   cluster-actions:
    72. 

  72.     cmd: python run.py --rust cluster group-actions -s bx-actions -o bx/bx-cluster-actions.parquet
    73. 

  73.     deps:
    74. 

  74.     - path: book-links/isbn-clusters.parquet
    75. 

  75.       md5: 9bb3676bec6b5b3c03fe4c25701c21f4
    76. 

  76.       size: 229330723
    77. 

  77.     - path: bx/cleaned-ratings.csv
    78. 

  78.       md5: da3196d4af84ae39b3713e73c59677c7
    79. 

  79.       size: 22627884
    80. 

  80.     - path: src/cli/cluster
    81. 

  81.       md5: a1d600e4111815f34cd366be955d3f8f.dir
    82. 

  82.       size: 25891
    83. 

  83.       nfiles: 11
    84. 

  84.     outs:
    85. 

  85.     - path: bx/bx-cluster-actions.parquet
    86. 

  86.       md5: ef6ef99b0f6702258ee776afe194460c
    87. 

  87.       size: 7251481
    88. 

  88.   schema@bx-cluster-actions:
    89. 

  89.     cmd: python ../run.py --rust pq-info -o bx-cluster-actions.json bx-cluster-actions.parquet
    90. 

  90.     deps:
    91. 

  91.     - path: bx-cluster-actions.parquet
    92. 

  92.       md5: ef6ef99b0f6702258ee776afe194460c
    93. 

  93.       size: 7251481
    94. 

  94.     outs:
    95. 

  95.     - path: bx-cluster-actions.json
    96. 

  96.       md5: 58ddaf3fb30964493a2cc4af56f259b4
    97. 

  97.       size: 489
    98. 

  98.   schema@bx-cluster-ratings:
    99. 

  99.     cmd: python ../run.py --rust pq-info -o bx-cluster-ratings.json bx-cluster-ratings.parquet
    100. 

  100.     deps:
    101. 

  101.     - path: bx-cluster-ratings.parquet
    102. 

  102.       md5: b37f08a3f38031c23c4db5cd73a5dc7d
    103. 

  103.       size: 3043911
    104. 

  104.     outs:
    105. 

  105.     - path: bx-cluster-ratings.json
    106. 

  106.       md5: 646155f2be2e610657f23af9551119a7
    107. 

  107.       size: 631
    108.
Prev
Next
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Write Preview
Loading...
Integrate Google Cloud Storage
Use Google Storage
Select bucket
Upload key
Finish

Use Google Cloud Storage!

Browsing data directories saved to Google Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Bookdata-tools is now integrated with Google Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate AWS S3
Use S3 remote
Select bucket
Access key
Finish

Use AWS S3 as storage!

Browsing data directories saved to S3 is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with AWS S3!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate S3 compatible storage
Use S3 like remote
Select bucket
Access key
Finish

Use any S3 compatible storage!

Browsing data directories saved to S3 compatible storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with your S3 compatible storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate Azure Cloud Storage
Use Azure Storage
Select bucket
Set key
Finish

Use Azure Cloud Storage!

Browsing data directories saved to Azure Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with Azure Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes