Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

eval_gpt2_large.py 215 B

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
  1. # evaluate the base gpt2
  2. # n_layer=36, n_head=20, n_embd=1280
  3. # 774M parameters
  4. batch_size = 8
  5. eval_iters = 500 # use more iterations to get good estimate
  6. eval_only = True
  7. wandb_log = False
  8. init_from = 'gpt2-large'
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Loading...