Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

#537 Quantization infra mods for different calibrators and learnable amax

Merged
Ghost merged 1 commits into Deci-AI:master from deci-ai:feature/AL-706-selective-qat
1
2
3
4
5
6
7
8
9
10
11
12
13
  1. from torch import optim
  2. from super_gradients.common.object_names import Optimizers
  3. from super_gradients.training.utils.optimizers.rmsprop_tf import RMSpropTF
  4. from super_gradients.training.utils.optimizers.lamb import Lamb
  5. OPTIMIZERS = {
  6. Optimizers.SGD: optim.SGD,
  7. Optimizers.ADAM: optim.Adam,
  8. Optimizers.RMS_PROP: optim.RMSprop,
  9. Optimizers.RMS_PROP_TF: RMSpropTF,
  10. Optimizers.LAMB: Lamb
  11. }
Discard
Tip!

Press p or to see the previous file or, n or to see the next file