Articles tagged lora
1 articles
Fine-tuning with limited hardware resources
- AI Geek Programmer
- NLP
- 26 June 2023
Efficient fine-tuning of a large language model in Google Colab using PEFT, LoRa and quantization (base model: RedPajama INCITE Chat 3B)
Read articleTags
- machine learning
- artificial intelligence
- deep learning
- shape recognition
- python
- keras
- convolutional neural networks
- numpy
- cifar10
- convnets
- tensorflow
- ai
- overfitting
- anaconda
- mnist
- pytorch
- data augmentation
- development environment
- dropout
- GPU
- nlp
- scikit-learn
- transformer architecture
- batch normalization
- blockchain
- digits dataset
- google colab
- huggingface
- internal covariate shift
- k-nn