Articles tagged pytorch

3 articles

Fine-tuning with limited hardware resources

Fine-tuning with limited hardware resources

  • AI Geek Programmer
  • NLP
  • 26 June 2023

Efficient fine-tuning of a large language model in Google Colab using PEFT, LoRa and quantization (base model: RedPajama INCITE Chat 3B)

Read article
PyTorch: dividing dataset, transformations, training on GPU and metric visualization

PyTorch: dividing dataset, transformations, training on GPU and metric visualization

Practical tips on dividing a dataset for training, validation and testing, applying transformations, moving to a GPU and metrics visualization.

Read article
Data preparation with Dataset and DataLoader in Pytorch

Data preparation with Dataset and DataLoader in Pytorch

How to use Dataset and DataLoader classes to prepare data for machine learning in PyTorch

Read article