RWKV-4

RWKV (pronounced RwaKuv) language model is an RNN with GPT-level LLM performance, and it can also be directly trained like a GPT transformer (parallelizable).

Installation and Setup

• Install the Python rwkv and tokenizer packages

pip install rwkv tokenizer

• Download a RWKV model and place it in your desired directory
• Download a tokens file

LLMs

RWKV

See a usage example.

from langchain_community.llms import RWKV

API Reference:RWKV