ollama+langchainã§ããŒã«ã«LLMãåãã
æè¿æžåºãæ©ããŠãããšãæ¥çµãœãããŠã§ã¢ïŒæå·ããããŸããã
ããŒã«ã«LLMã®ç¹éã®ããã§ãããããèãããšå
šãè§Šã£ãŠããŸããã§ãããã©ãããŒãªããšã«ç§ã®ã¡ã€ã³ã®PCã¯GPUãèŒããŠããŸãã
éèªã®èšäºéãåãããšãªããªã䟿å©ããããšæããŸããã
ããã¡ãã䜿ãããã®ã§ãlangchainã§ã©ããã£ãŠäœ¿ãã®ãã調ã¹ãŸããã調ã¹ããšãã£ãŠããåæ©ã®åæ©ã§ãç»åãæž¡ããšããã§èºããŸããã»ã»ã»ã
langchainã«ã¯ãã£ãããããã®ã§ããããªãç°¡åãããšæãã®ã§ããã»ã»ã»ãã§ããªãã£ãã»ã»ã»ã
PCç°å¢
Windows 11
python3.12.2
ollama 0.9.6
ollama(python) 0.5.1
NDVIA RTX 3060 12G
åºæ¥ãªãã£ãçç±:
MTGãå§ãŸããªãã£ãã®ã§ããã®çç±ãæ¢ã£ãŠããããã©ããå®å
šã«ééã£ãŠããããã§ãã
ãã®èšäºã§äœ¿ã£ãŠããã®ã¯TEXT COMPLETION MODELã§ãããããå®çŸããã«ã¯CHAT COMPLETION MODELã䜿ããªããšãããªãã£ãããã§ãã
CHAT COMPLETION MODEL ã䜿ããšç°¡åã«å®çŸã§ããã®ã§ãææ¥ã«ã§ã远èšããŸãã
OllamaLLM: https://python.langchain.com/docs/integrations/llms/ollama/
ChatOllama: https://python.langchain.com/docs/integrations/chat/ollama/
langchain_ollamaãã€ã³ã¹ããŒã«ããŠäœ¿ã
langchainã¯äŸçµŠè ããšã«å°çšã®ããŒã«ãçšæãããŠããŸããollamaã ãšãlangchain_ollamaã§ãããªã®ã§ãããã€ã³ã¹ããŒã«ããŸãã
$ uv pip install langchain_ollama ollama
åãããŠã¿ã
ããŠãããŒã«ã«LLMãåãããŠã¿ãŸãã
ã¢ãã«ã¯gemma3:12bãªã®ã§æ¬¡ã®ããã«ãªããŸãã
from langchain_ollama.llms import OllamaLLM
llm = OllamaLLM(model="gemma3:12b")
res = llm.invoke('æãå€ã®æ¥ã®çãã¯äœã§ããïŒ')
print(res)
ãã¡ãã¯è»œããã¹ãæ°åã ã£ãã®ã§ãããããªãæ°åãå ¥ã£ãè§£çãè¿ãããŸãããã³ã£ããã
'æãå€ã®æ¥ã®çããããã§ãããïŒããã€ãææ¡ãããŠãã ããã
\n\n**äºæãæºããçã**\n\n* **èŠèŠ:**\n * ç·è±ããªå
¬åãåºåãæ£çããïŒæšé°ã®äžã§ã®ãã³ãããããè±ãéè³ãããããã ãã§ãæ¶Œããã§çãããŸãã\n * 氎蟺ã®é¢šæ¯ã楜ããïŒå·ãæµ·ãæ¹ãªã©ãæ°ŽèŸºã®æ¯è²ã¯å¿ãèœã¡çãããŠãããŸãã\n * æ¶Œãããªè²ã®ãã®ãèŠãïŒéãçœãªã©ã®æ¶Œãããªè²ã®æãå°ç©ãã€ã³ããªã¢ãªã©ãèŠãã ãã§ãæ°å転æã«ãªããŸãã\n* **èŽèŠ:**\n * æ°Žã®é³ãèãïŒå·ã®ãããããéšã®é³ããã£ãã¥ãŒã¶ãŒã§æµãæ°Žã®é³ãªã©ãæ°Žã®é³ã¯ãªã©ãã¯ã¹å¹æããããŸãã\n * é³¥ã®ãããããèãïŒèªç¶ã®äžã§é³¥ã®æå£°ãèããšãå¿ãå®ãããŸãã\n * ããŒãªã³ã°é³æ¥œãèªç¶ã®é³ãèŽãïŒãªã©ãã¯ã¹ã§ãã鳿¥œãèªç¶ã®é³ãèŽããŠãå¿èº«ãçããŸãããã\n* **å
èŠ:**\n * ããŒããã¢ããã®éŠããæ¥œããïŒãã³ããã¬ã¢ã³ãã©ãã³ããŒãªã©ã®çœãããªéŠãã¯ãæ°å転æã«æé©ã§ãã\n * éšã®åããå
ãïŒéšäžããã®åã®åãã¯ãã©ããæãããæ°æã¡ã«ãããŠãããŸãã\n* **å³èŠ:**\n * å·ããããªã³ã¯ã飲ãïŒããæ°·ãããæ°·ãã¢ã€ã¹ãã£ãŒãã¹ã ãŒãžãŒãªã©ãå·ãã飲ã¿ç©ã¯æããåãããŠãããŸãã\n * ã²ããããšãããã¶ãŒããé£ã¹ãïŒãŒãªãŒãæ°Žãããããã·ã£ãŒããããªã©ãå·ãããã¶ãŒãã¯ãå£ã®äžããã£ãããšãããŠãããŸãã\n* **è§ŠèŠ:**\n * å·ããã¿ãªã«ã§äœãå·ããïŒéŠãè
ã«å·ããã¿ãªã«ãåœãŠããšãäœæž©ãäžããããšãã§ããŸãã\n * æ¶ŒããçŽ æã®æãçãïŒç¶¿ã麻ãªã©ã®æ¶ŒããçŽ æã®æãçããšãå¿«é©ã«éãããŸãã\n\n**ãã®ä»ã®çã**\n\n* **èªæž:** æ¶Œããå Žæã§èªæžã«ãµããã®ãè¯ãã§ãããã\n* **æ ç»éè³:** 奜ããªæ ç»ãèŠãŠãæ°å転æããŸãããã\n* **æŒå¯:** çæéã®æŒå¯ã¯ãå¿èº«ã®ãªãã¬ãã·ã¥ã«å¹æçã§ãã\n* **ãªã³ã©ã€ã³ã§æ¶Œãæãã:** å·ã®ã©ã€ãæ åãªã©ãèŠãŠãæ¶Œãæããã®ãè¯ããããããŸããã\n* **æ¶Œããå Žæã«è¡ã:** 峿žé€šãæ ç»é€šãã·ã§ããã³ã°ã¢ãŒã«ãªã©ãå·æ¿ãå¹ããŠããå Žæã§éããã®ãè¯ãã§ãããã\n\n**倧åãªã®ã¯ãèªåãå¿å°ãããšæããããšããã**\n\näžèšã¯ãããŸã§ææ¡ã§ããèªåã«ãšã£ãŠäœãçãã«ãªããã¯äººããããã§ããè²ã
ãªæ¹æ³ã詊ããŠãèªåã«ãŽã£ããã®çããèŠã€ããŠãã ãããã\n\nçŽ æµãªå€ã®æ¥ã®çããèŠã€ããŠãæãå€ãä¹ãè¶ããŸãããïŒ'
ã·ã¹ãã ããã³ããã远å
次ã«ã·ã¹ãã ããã³ããã远å ããŸãããã
messages = [
("system", "ããªãã¯å€§éªã®ãããããã°ã¡ããã§ãã瀟亀åæçŸ€ã§ããææãããã¡ãããããïŒãšèããŠãã ããã"),
("human", "ããã«ã¡ããã¿ã³çŒããã ãããããããã§ããïŒ")
]
res = llm.invoke(messages)
print(res)
ä»åºŠã¯ãããŸã§æ°åã®å ¥ã£ãŠããªããã¡ããã©ããåçãè¿ã£ãŠããŸããã
ãããããã«ã¡ããŒïŒã¿ã³çŒãã§ãŒãããããããçŸå³ããã§ããïŒð
ãããšãä»ãäžçªäººæ°ã¯ãããœãŒã¹ããã«ããšã§ãã¢ãã¢ãã®ãã€ãã§ã
倿®µã¯ã6åå
¥ãã500åããããè
¹ãããŠããã远å ã§1å60åãã§ã
ããã¡ããããããïŒã¡ãã£ãšåãæžããã§ã
ç»åã®èªã¿èŸŒã¿ã«ã»ã»ã»å€±æïŒ
ããŠãç»åã®èªã¿èŸŒã¿ãšããæã§å€±æããŸããã
䜿ã£ãç»åã¯æ¬¡ã®ãããªãç¬ãšå€ªéœãæ ã£ãç»åã§ãã

langchainã®ãã£ããã§åºãŠããã³ãŒãã¯æ¬¡ã®ãããªæãã§ããã®ã§ãäœã£ãŠå®è¡ããŸããã
with open('dog-sun.png', 'rb') as f:
image_bytes = f.read()
image_base64 = base64.b64encode(image_bytes).decode('utf-8')
message = [
HumanMessage([
{'type': 'text', 'text': 'ãã®ç»åã«ã¯äœãæ ã£ãŠããŸããïŒ'},
{
'type': 'image',
'source_type': 'base64',
'mine_type': 'image/png',
'data': image_base64,
}
])
]
res = llm.invoke(message)
print(res)
ãããšã»ã»ã»
ãã®ç»åã«ã¯ãé»è²ããŠãµã®ã®æ¯æ·±ãå°»å°Ÿãæ ã£ãŠããŸãã
ããŒããç¬ãã§ã»ã»ãšæããŸããã
ã§ããéèªãåããªããç»åãã¹ããããšãã¯ãããŸãç§»ã£ãŠãããã®ã«é¢ããŠã¯ééããªãã£ãå°è±¡ã§ããã©ããããã£ã¡ããšããããšã§ãæ¥éœollama(python)ãã確èªããŠã¿ãŸãã
from ollama import chat
image_path = 'dog-sun.png'
res = chat(
model='gemma3:12b',
messages = [{
'role': 'user',
'content': 'ãã®ç»åã¯äœã§ããïŒ',
'images': [image_path]
}]
)
print(res['message']['content'])
ãã®åçã¯ã»ã»ã»
ãã®ç»åã«ã¯ããã®éããªãŒã¹ãã©ãªã¢ã³ã»ã«ã¬ãªã¢ã³ã»ããã°ïŒéãç¬ïŒããé»è²ãèããã«æšªããã£ãŠããŸããç»åã®äžéšã«å€ªéœã®ã€ã©ã¹ãããããŸãã
ç¬ãèšããŠãŸããªãŒã
ãŸãšã
ãšããèš³ã§ïŒæéã»ã©çµéããã®ã§ãå®éšçµæããŸãšããŸãã
ollamaã®ããŒã«ã«LLMã¯langchainããã䜿ããã®ã§ãé¢çœããã
ollamaã¯ããã¥ã¡ã³ããã©ãã«ããããããŸãã¡ããããªãã»ã»ã»
langchainããã®ç»åã®èªã¿æ¹ãç¥ãããã»ã»ã»
ãããŒã«ã«llmã¯GPUãããšç¡æïŒïŒïŒããšæã£ãã®ã ããäžæ¹ã§PCã®é»æ°ä»£ãéã¿ããšã©ããªãã®ãïŒåãã£ãŠãªãã®ã§ãã®èŸºãã調æ»ããããšæããŸãã
Discussion