Deep Learning and Neural Network Diagrams

A collection of TikZ diagrams for deep learning and neural network concepts. This repository was created to provide a set of open-source diagrams for use in academic papers, presentations, and other documents. The diagrams are designed to be easily customisable and can be used in LaTeX documents. Note that this repository is a work in progress and more diagrams will be added over time.

Examples

Transformer - Vaswani et al. (2017)

Multi-Head Attention - Vaswani et al. (2017)

Neural Network

Attention Mechanism - Bahdanau et al. (2014)

Gated Recurrent Unit (GRU) - Cho et al. (2014)

RNN Encoder-Decoder - Sutskever et al. (2014)

Backpropagation Through Time (BPTT) - Werbos (1990)

Citation

If you use this repository in your research or project, please cite it as follows:

@misc{love2024nntikz,
    author = {Fraser Love},
    title = {TikZ Diagrams for Deep Learning and Neural Networks},
    year = 2024,
    url = {https://github.com/fraserlove/nntikz},
    note = {GitHub repository}
}