Repository navigation

FasterTransformer

Public

forked from NVIDIA/FasterTransformer

About

Transformer related optimization, including BERT, GPT

Custom properties

39 stars

2 watching

Report repository

Name		Name	Last commit message	Last commit date
.github/ISSUE_TEMPLATE		.github/ISSUE_TEMPLATE
.gitlab		.gitlab
.vscode		.vscode
3rdparty		3rdparty
benchmarks		benchmarks
cmake		cmake
docker		docker
docs		docs
examples		examples
src		src
templates/adding_a_new_model		templates/adding_a_new_model
tests		tests
.clang-format		.clang-format
.flake8		.flake8
.gitignore		.gitignore
.gitlab-ci.yml		.gitlab-ci.yml
.gitmodules		.gitmodules
CMakeLists.txt		CMakeLists.txt
CONTRIBUTING.md		CONTRIBUTING.md
LICENSE		LICENSE
README.md		README.md

Repository files navigation

FasterTransformer

This repository is based on FasterTransformer adapted to GLM-130B, for FasterTransformer, please read the original project.

Quick Start

Read inference-with-fastertransformer.

About

Transformer related optimization, including BERT, GPT

Custom properties

39 stars

2 watching

Report repository

Releases

Packages

Contributors

Languages