AI Geek Programmer Blog

Machine learning, computer vision, deep learning and artificial intelligence engineering.

Crafting Text Generators: A Dive into Transformer Architecture

Crafting Text Generators: A Dive into Transformer Architecture

  • AI Geek Programmer
  • NLP
  • 19 August 2023

A small decoder-based language model. Or how to use part of the Transformer architecture to generate text resembling a well-known literary work (Pytorch).

Read article
Fine-tuning with limited hardware resources

Fine-tuning with limited hardware resources

  • AI Geek Programmer
  • NLP
  • 26 June 2023

Efficient fine-tuning of a large language model in Google Colab using PEFT, LoRa and quantization (base model: RedPajama INCITE Chat 3B)

Read article
Welcome tomorrow - how AI will shape the world by 2032

Welcome tomorrow - how AI will shape the world by 2032

Some of my thoughts and predictions on how AI will change the world in the next 10 years.

Read article
PyTorch: dividing dataset, transformations, training on GPU and metric visualization

PyTorch: dividing dataset, transformations, training on GPU and metric visualization

Practical tips on dividing a dataset for training, validation and testing, applying transformations, moving to a GPU and metrics visualization.

Read article
Data preparation with Dataset and DataLoader in Pytorch

Data preparation with Dataset and DataLoader in Pytorch

How to use Dataset and DataLoader classes to prepare data for machine learning in PyTorch

Read article
YOLO fast object detection and classification

YOLO fast object detection and classification

YOLO fast object detection and classification. Brief introduction to the YOLO algorithm plus installation tips for Ubuntu.

Read article