Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

#396 Trainer constructor cleanup

Merged
Ghost merged 1 commits into Deci-AI:master from deci-ai:feature/SG-266_clean_trainer_ctor
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
  1. defaults:
  2. - default_train_params
  3. max_epochs: 450
  4. lr_mode: step
  5. initial_lr: 0.032 # for total batch-size of 512
  6. lr_decay_factor: 0.973
  7. lr_updates:
  8. _target_: numpy.arange
  9. start: 2.4
  10. stop: 450
  11. step: 2.4
  12. lr_warmup_epochs: 5
  13. optimizer: RMSpropTF
  14. optimizer_params:
  15. weight_decay: 0.00001
  16. momentum: 0.9
  17. alpha: 0.9
  18. eps: 0.001
  19. loss: cross_entropy
  20. zero_weight_decay_on_bias_and_bn: True
  21. ema: True
  22. ema_params:
  23. decay: 0.9999
  24. mixed_precision: True
  25. metric_to_watch: Accuracy
  26. greater_metric_to_watch_is_better: True
  27. train_metrics_list: # metrics for evaluation
  28. - Accuracy
  29. - Top5
  30. valid_metrics_list: # metrics for evaluation
  31. - Accuracy
  32. - Top5
  33. _convert_: all
Discard
Tip!

Press p or to see the previous file or, n or to see the next file