Articles tagged self attention
1 articles
Crafting Text Generators: A Dive into Transformer Architecture
- AI Geek Programmer
- NLP
- 19 August 2023
A small decoder-based language model. Or how to use part of the Transformer architecture to generate text resembling a well-known literary work (Pytorch).
Read articleTags
- machine learning
- artificial intelligence
- deep learning
- shape recognition
- python
- keras
- convolutional neural networks
- numpy
- cifar10
- convnets
- tensorflow
- ai
- overfitting
- anaconda
- mnist
- pytorch
- data augmentation
- development environment
- dropout
- GPU
- nlp
- scikit-learn
- transformer architecture
- batch normalization
- blockchain
- digits dataset
- google colab
- huggingface
- internal covariate shift
- k-nn