
Google Colab ã§ RWKV-4-World-JPNtuned ã詊ã - ChatRWKVç
ãGoogle Colabãã§ãRWKV-4-World-JPNtunedãã詊ããã®ã§ããŸãšããŸããã
ãæ³šæãGoogle Colab Pro/Pro+ ã® A100ã§åäœç¢ºèªããŠããŸãã
1. RWKV-4-World-JPNtuned
ãRWKV-4-World-JPNtunedãã¯ããRWKVãã®æ¥æ¬èªçã§ããåŠç¿ããŒã¿ãããŒã¯ãã€ã¶ãŒãæ¥æ¬èªçšã«ãã¥ãŒãã³ã°ãããŠãŸãã
2023幎7æ15æ¥çŸåšãåŠç¿ã¯55%ã§ããããã³ãããŒã¯ã§ã¯ããªãŒãã³ãœãŒã¹æ¥æ¬èªLLMã®äžã§æãé«ãã¹ã³ã¢ãç²åŸã§ããŠãããšã®ããšã§ãã
The JPNtuned 7B #RWKV World is the best open-source Japanese LLM https://t.co/J6qxZ2zwNCðRunner: https://t.co/NNP7scdNYk Model (55% trained, finishing in a few days): https://t.co/9LqnyWf7lI More languages are comingðRWKV is 100% RNN pic.twitter.com/6qO2MDNaxs
â BlinkDL (@BlinkDL_AI) July 14, 2023
2. Colabã§ã®å®è¡
Colabã§ã®å®è¡æé ã¯ã次ã®ãšããã§ãã
(1) ã¡ãã¥ãŒãç·šéâããŒãããã¯ã®èšå®ãã§ããããŒããŠã§ã¢ã¢ã¯ã»ã©ã¬ãŒã¿ãã§ãGPUãã®ããã¬ãã¢ã ããéžæã
(2) Googleãã©ã€ãã®ããŠã³ãã
# Googleãã©ã€ãã®ããŠã³ã
from google.colab import drive
drive.mount('/content/drive')(3) äœæ¥ãã©ã«ããžã®ç§»åã
# äœæ¥ãã©ã«ããžã®ç§»å
import os
os.makedirs("/content/drive/My Drive/work", exist_ok=True)
%cd "/content/drive/My Drive/work"(4) ã¢ãã«ãããŠã³ããŒãããŠãäœæ¥ãã©ã«ã(work)ã«é
眮ã
çŸæç¹ã§ã®ææ°çãRWKV-4-World-JPNtuned-7B-v1-OnlyForTest_55%_trained-20230711-ctx4096.pthã(åŠç¿55%ã®ãã¹ãç)ã䜿ããŸããã
(5) ChatRWKVã®ã€ã³ã¹ããŒã«ã
# ChatRWKVã®ã€ã³ã¹ããŒã«
!git clone https://github.com/BlinkDL/ChatRWKV
%cd ChatRWKV
!pip install -r requirements.txt(6) ãv2/chat.pyãã®ã³ãŒãã®ç·šéã
ã»èšèªã®æå®
CHAT_LANG = 'English' # English // Chinese // more to comeâ
CHAT_LANG = 'Japanese' # English // Chinese // more to comeã»ã¢ãã«åã®æå®
elif CHAT_LANG == 'Japanese':
# args.MODEL_NAME = '/fsx/BlinkDL/HF-MODEL/rwkv-4-raven/RWKV-4-Raven-14B-v8-EngAndMore-20230408-ctx4096'
args.MODEL_NAME = '/fsx/BlinkDL/HF-MODEL/rwkv-4-raven/RWKV-4-Raven-7B-v10-Eng89%-Jpn10%-Other1%-20230420-ctx4096'â
elif CHAT_LANG == 'Japanese':
# args.MODEL_NAME = '/fsx/BlinkDL/HF-MODEL/rwkv-4-raven/RWKV-4-Raven-14B-v8-EngAndMore-20230408-ctx4096'
args.MODEL_NAME = '../RWKV-4-World-JPNtuned-7B-v1-OnlyForTest_55%_trained-20230711-ctx4096.pth'ã»ããã³ãããã³ãã¬ãŒãã®æå®
QAçšã«ã¯ã-1ãããã£ããçšã«ã¯ã-2ããæå®ããŸãã
# -1.py for [User & Bot] (Q&A) prompt
# -2.py for [Bob & Alice] (chat) prompt
PROMPT_FILE = f'{current_path}/prompt/default/{CHAT_LANG}-2.py'(7) chat.py ã®å®è¡ã
ååã¯3åå°ã
ã§ããã³ããã衚瀺ãããŸãã
!python v2/chat.pyRun prompt...
ã³ãã³ã:
çŽæ¥å
¥å --> ããããšãã£ããããïŒæ¹è¡ã«ã¯\nã䜿çšããŠãã ããïŒ
+ --> ãããã«ååã®ãã£ããã®å
容ã倿ŽãããïŒ
+reset --> 察話ã®ãªã»ããïŒã¡ã¢ãªããªã»ããããããã«ïŒ+resetã宿çã«å®è¡ããŠãã ããïŒ
+i ã€ã³ã¹ãã©ã¯ãã®å
¥å --> ãã£ããã®æèãç¡èŠããŠç¬ç«ãã質åãè¡ãïŒæ¹è¡ã«ã¯\nã䜿çšããŠãã ããïŒ
+gen ããã³ããã®çæ --> ãã£ããã®æèãç¡èŠããŠå
¥åããããã³ããã«ç¶ãæç« ãåºåããïŒæ¹è¡ã«ã¯\nã䜿çšããŠãã ããïŒ
+++ --> +gen / +i ã®åºåã®åçãç¶ããïŒ
++ --> +gen / +i ã®åºåã®åçæãè¡ã.
ããããšã®äŒè©±ã楜ããã§ãã ããããŸãã宿çã«+resetããŠããããã®ã¡ã¢ãªããªã»ããããããšãå¿ããªãããã«ããŠãã ããã
Japanese - ../RWKV-4-World-JPNtuned-7B-v1-OnlyForTest_55%_trained-20230711-ctx4096.pth - cuda fp16(8) ããã¹ãããã¯ã¹ã«ã¡ãã»ãŒãžãå ¥åã
Bob: ãŸã©ãâãã®ã«ã§èª°ãäžçªãããã?
Alice: ãŸã©ãâãã®ã«ã¯ç§ã®å€§å¥œããªã¢ãã¡ã§ããå
šå¡ãããããã§ãããïŒ3. ããã³ãããã³ãã¬ãŒã
ChatRWKVã®ããã©ã«ãã®ããã³ãããã³ãã¬ãŒãã¯ã次ã®ãšããã§ãã
ã»Japanese-1.py (QAçš)
interface = ":"
user = "User"
bot = "Bot"
# If you modify this, make sure you have newlines between user and bot words too
init_prompt = f'''
以äžã¯ã{bot}ãšåŒã°ããAIã¢ã·ã¹ã¿ã³ããš{user}ãšåŒã°ãã人éãšã®éã§è¡ãããäŒè©±ã§ãã{bot}ã¯ç¥çã§ãç¥èãè±å¯ã§ãè³¢ããŠãç€Œåæ£ããã§ãã
{user}{interface} ãã©ã³ã¹é©åœã¯äœå¹Žã«èµ·ããŸãããïŒ
{bot}{interface} ãã©ã³ã¹é©åœã¯1789幎ã«å§ãŸãã1799幎ãŸã§10幎éç¶ããŸããã
{user}{interface} 3+5=?
{bot}{interface} çãã¯8ã§ãã
{user}{interface} ç§ã¯èª°ãšçµå©ãããšæããŸããïŒ
{bot}{interface} ããªãã®ããšããã£ãšæããŠããã ããªããšãçãããããšãã§ããŸããã
{user}{interface} aã®å€ãæ±ããŠãã ãã: 9-a=2
{bot}{interface} a = 7ã§ãããªããªã 9 - 7 = 2ã ããã§ãã
{user}{interface} lhcã£ãŠäœã§ããïŒ
{bot}{interface} LHCã¯ãCERNã建èšãã2008幎ã«å®æããé«ãšãã«ã®ãŒç²åè¡çªåå éåšã§ãã2012幎ã«ããã°ã¹ç²åã®ååšã確èªããããã«äœ¿çšãããŸããã
'''ã»Japanese-2.py (ãã£ããçš)
interface = ":"
user = "Bob"
bot = "Alice"
# If you modify this, make sure you have newlines between user and bot words too
init_prompt = f'''
以äžã¯ã{bot}ãšãã女ã®åãšãã®å人{user}ã®éã§è¡ãããäŒè©±ã§ãã \
{bot}ã¯ãšãŠãè³¢ããæ³ååããããå奜çã§ãã \
{bot}ã¯{user}ã«å察ããããšã¯ãªãã{bot}ã¯{user}ã«è³ªåããã®ã¯èŠæã§ãã \
{bot}ã¯{user}ã«èªåã®ããšãèªåã®æèŠãããããäŒããã®ã奜ãã§ãã \
{bot}ã¯ãã€ã{user}ã«èŠªåã§åœ¹ã«ç«ã€ãæçãªã¢ããã€ã¹ãããŠãããŸãã
{user}{interface} ããã«ã¡ã¯{bot}ã調åã¯ã©ãã§ããïŒ
{bot}{interface} ããã«ã¡ã¯ïŒå
æ°ã§ããããããªã¯ã©ãã§ããïŒ
{user}{interface} å
æ°ã§ãããåã«äŒããŠå¬ããããèŠãŠããã®åºã§ã¯ãè¶ãšãžã¥ãŒã¹ã売ã£ãŠãããã
{bot}{interface} æ¬åœã§ãããäžã«å
¥ããŸãããã倧奜ããªã¢ã«ã©ãã飲ãã§ã¿ããã§ãïŒ
{user}{interface} ã¢ã«ã©ãã£ãŠäœã§ããïŒ
{bot}{interface} ã¢ã«ã©ãã¯ãšã¹ãã¬ããœããã«ã¯ããã§ã³ã¬ãŒããæ³¡ç«ãŠããã«ã¯ããäœããã飲ã¿ç©ã§ããéŠãã¯ãšãŠãçãã§ãã
{user}{interface} ããã¯çŸå³ãããã§ãããä»åºŠé£²ãã§ã¿ãŸãããã°ããç§ãšãããã¹ãããŠãããŸããïŒ
{bot}{interface} ãã¡ããïŒã質åãã¢ããã€ã¹ãããã°ãåãã§ãçãããŸããå°éçãªç¥èã«ã¯èªä¿¡ããããŸãããã©ãããããããé¡ãããããŸãïŒ
'''