Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Devin Schumacher 2d98f56bdd
Create FUNDING.yml
8 months ago
1962063f04
Merge branch 'main' of https://github.com/serp-ai/LLaMA-8bit-LoRA
9 months ago
46f050b099
better search results
1 year ago
937bb7f28b
Update abstract.md
1 year ago
d38b305dee
add QLoRA (4-bit) and LLaMA 2 support
9 months ago
2d98f56bdd
Create FUNDING.yml
8 months ago
93d03de03f
Update README.md
9 months ago
b0e12b509e
Initial commit
1 year ago
d38b305dee
add QLoRA (4-bit) and LLaMA 2 support
9 months ago
122b65e074
Replace automodel and tokenizer with llama version
1 year ago
d38b305dee
add QLoRA (4-bit) and LLaMA 2 support
9 months ago
Storage Buckets

README.md

You have to be logged in to leave a comment. Sign In

Chat LLaMA

8bit-LoRA or 4bit-LoRA

Repository for training a LoRA for the LLaMA (1 and 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only for LLaMA 1, LLaMA 2 is open commercially.


👉 Join our Discord Server for updates, support & collaboration


Dataset creation, training, weight merging, and quantization instructions are in the docs.

Check out our trained LoRAs on HuggingFace

Anthropic's HH

Tip!

Press p or to see the previous file or, n or to see the next file

About

Repository for training a LoRA for the LLaMA model on HuggingFace with 8-bit quantization. Research only.

Collaborators 1

Comments

Devin Schumacher

commented in commit937bb7f28bon branch main

1 year ago Outdated
Loading...