bertviz
BertViz is a tool for visualizing attention mechanisms in Transformer models such as BERT, GPT-2, and T5. It supports Jupyter and Colab environments via a Python API, compatible with Huggingface models. By enhancing the Tensor2Tensor framework, BertViz provides unique insights through head, model, and neuron views, aiding researchers and developers in exploring attention layers.