Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Resources  
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Explore Pricing
Product  
Data Engine LLMs Platform Enterprise
Connect to Dagshub Discord channel
Register
Login

jinensetpal
/
vision
connected to https://github.com/jinensetpal/vision.git

Watch 1
Issues 0 Pull Requests 0 Discussions 0

datasets.rst 3.8 KB
Permalink History Raw

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192 
  1. .. _datasets:
    2. 

  2. 

  3. Datasets
    4. 

  4. ========
    5. 

  5. 

  6. Torchvision provides many built-in datasets in the ``torchvision.datasets``
    7. 

  7. module, as well as utility classes for building your own datasets.
    8. 

  8. 

  9. Built-in datasets
    10. 

  10. -----------------
    11. 

  11. 

  12. All datasets are subclasses of :class:`torch.utils.data.Dataset`
    13. 

  13. i.e, they have ``__getitem__`` and ``__len__`` methods implemented.
    14. 

  14. Hence, they can all be passed to a :class:`torch.utils.data.DataLoader`
    15. 

  15. which can load multiple samples in parallel using ``torch.multiprocessing`` workers.
    16. 

  16. For example: ::
    17. 

  17. 

  18.     imagenet_data = torchvision.datasets.ImageNet('path/to/imagenet_root/')
    19. 

  19.     data_loader = torch.utils.data.DataLoader(imagenet_data,
    20. 

  20.                                               batch_size=4,
    21. 

  21.                                               shuffle=True,
    22. 

  22.                                               num_workers=args.nThreads)
    23. 

  23. 

  24. .. currentmodule:: torchvision.datasets
    25. 

  25. 

  26. All the datasets have almost similar API. They all have two common arguments:
    27. 

  27. ``transform`` and  ``target_transform`` to transform the input and target respectively.
    28. 

  28. You can also create your own datasets using the provided :ref:`base classes <base_classes_datasets>`.
    29. 

  29. 

  30. .. warning::
    31. 

  31. 

  32.     When a dataset object is created with ``download=True``, the files are first
    33. 

  33.     downloaded and extracted in the root directory. This download logic is not
    34. 

  34.     multi-process safe, so it may lead to conflicts / race conditions if it is
    35. 

  35.     run within a distributed setting. In distributed mode, we recommend creating
    36. 

  36.     a dummy dataset object to trigger the download logic *before* setting up
    37. 

  37.     distributed mode.
    38. 

  38. 

  39. Image classification
    40. 

  40. ~~~~~~~~~~~~~~~~~~~~
    41. 

  41. 

  42. .. autosummary::
    43. 

  43.     :toctree: generated/
    44. 

  44.     :template: class_dataset.rst
    45. 

  45. 

  46.     Caltech101
    47. 

  47.     Caltech256
    48. 

  48.     CelebA
    49. 

  49.     CIFAR10
    50. 

  50.     CIFAR100
    51. 

  51.     Country211
    52. 

  52.     DTD
    53. 

  53.     EMNIST
    54. 

  54.     EuroSAT
    55. 

  55.     FakeData
    56. 

  56.     FashionMNIST
    57. 

  57.     FER2013
    58. 

  58.     FGVCAircraft
    59. 

  59.     Flickr8k
    60. 

  60.     Flickr30k
    61. 

  61.     Flowers102
    62. 

  62.     Food101
    63. 

  63.     GTSRB
    64. 

  64.     INaturalist
    65. 

  65.     ImageNet
    66. 

  66.     Imagenette
    67. 

  67.     KMNIST
    68. 

  68.     LFWPeople
    69. 

  69.     LSUN
    70. 

  70.     MNIST
    71. 

  71.     Omniglot
    72. 

  72.     OxfordIIITPet
    73. 

  73.     Places365
    74. 

  74.     PCAM
    75. 

  75.     QMNIST
    76. 

  76.     RenderedSST2
    77. 

  77.     SEMEION
    78. 

  78.     SBU
    79. 

  79.     StanfordCars
    80. 

  80.     STL10
    81. 

  81.     SUN397
    82. 

  82.     SVHN
    83. 

  83.     USPS
    84. 

  84. 

  85. Image detection or segmentation
    86. 

  86. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    87. 

  87. 

  88. .. autosummary::
    89. 

  89.     :toctree: generated/
    90. 

  90.     :template: class_dataset.rst
    91. 

  91. 

  92.     CocoDetection
    93. 

  93.     CelebA
    94. 

  94.     Cityscapes
    95. 

  95.     Kitti
    96. 

  96.     OxfordIIITPet
    97. 

  97.     SBDataset
    98. 

  98.     VOCSegmentation
    99. 

  99.     VOCDetection
    100. 

  100.     WIDERFace
    101. 

  101. 

  102. Optical Flow
    103. 

  103. ~~~~~~~~~~~~
    104. 

  104. 

  105. .. autosummary::
    106. 

  106.     :toctree: generated/
    107. 

  107.     :template: class_dataset.rst
    108. 

  108. 

  109.     FlyingChairs
    110. 

  110.     FlyingThings3D
    111. 

  111.     HD1K
    112. 

  112.     KittiFlow
    113. 

  113.     Sintel
    114. 

  114. 

  115. Stereo Matching
    116. 

  116. ~~~~~~~~~~~~~~~
    117. 

  117. 

  118. .. autosummary::
    119. 

  119.     :toctree: generated/
    120. 

  120.     :template: class_dataset.rst
    121. 

  121. 

  122.     CarlaStereo
    123. 

  123.     Kitti2012Stereo
    124. 

  124.     Kitti2015Stereo
    125. 

  125.     CREStereo
    126. 

  126.     FallingThingsStereo
    127. 

  127.     SceneFlowStereo
    128. 

  128.     SintelStereo
    129. 

  129.     InStereo2k
    130. 

  130.     ETH3DStereo
    131. 

  131.     Middlebury2014Stereo
    132. 

  132. 

  133. Image pairs
    134. 

  134. ~~~~~~~~~~~
    135. 

  135. 

  136. .. autosummary::
    137. 

  137.     :toctree: generated/
    138. 

  138.     :template: class_dataset.rst
    139. 

  139. 

  140.     LFWPairs
    141. 

  141.     PhotoTour
    142. 

  142. 

  143. Image captioning
    144. 

  144. ~~~~~~~~~~~~~~~~
    145. 

  145. 

  146. .. autosummary::
    147. 

  147.     :toctree: generated/
    148. 

  148.     :template: class_dataset.rst
    149. 

  149. 

  150.     CocoCaptions
    151. 

  151. 

  152. Video classification
    153. 

  153. ~~~~~~~~~~~~~~~~~~~~
    154. 

  154. 

  155. .. autosummary::
    156. 

  156.     :toctree: generated/
    157. 

  157.     :template: class_dataset.rst
    158. 

  158. 

  159.     HMDB51
    160. 

  160.     Kinetics
    161. 

  161.     UCF101
    162. 

  162. 

  163. Video prediction
    164. 

  164. ~~~~~~~~~~~~~~~~~~~~
    165. 

  165. 

  166. .. autosummary::
    167. 

  167.     :toctree: generated/
    168. 

  168.     :template: class_dataset.rst
    169. 

  169. 

  170.     MovingMNIST
    171. 

  171. 

  172. .. _base_classes_datasets:
    173. 

  173. 

  174. Base classes for custom datasets
    175. 

  175. --------------------------------
    176. 

  176. 

  177. .. autosummary::
    178. 

  178.     :toctree: generated/
    179. 

  179.     :template: class.rst
    180. 

  180. 

  181.     DatasetFolder
    182. 

  182.     ImageFolder
    183. 

  183.     VisionDataset
    184. 

  184. 

  185. Transforms v2
    186. 

  186. -------------
    187. 

  187. 

  188. .. autosummary::
    189. 

  189.     :toctree: generated/
    190. 

  190.     :template: function.rst
    191. 

  191. 

  192.     wrap_dataset_for_transforms_v2
    193.
Prev
Next
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Write Preview
Loading...
Integrate AWS S3
Use S3 remote
Select bucket
Access key
Finish

Use AWS S3 as storage!

Browsing data directories saved to S3 is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

vision is now integrated with AWS S3!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate Google Cloud Storage
Use Google Storage
Select bucket
Upload key
Finish

Use Google Cloud Storage!

Browsing data directories saved to Google Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Google Storage bucket

Service Account Key

Congratulations!

vision is now integrated with Google Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate Azure Cloud Storage
Use Azure Storage
Select bucket
Set key
Finish

Use Azure Cloud Storage!

Browsing data directories saved to Azure Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

vision is now integrated with Azure Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate S3 compatible storage
Use S3 like remote
Select bucket
Access key
Finish

Use any S3 compatible storage!

Browsing data directories saved to S3 compatible storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Bucket name cannot be the same as the repository name. Please change one of them.

Access key (If needed)

Congratulations!

vision is now integrated with your S3 compatible storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes