yi:34b-chat-q3_K

yi:34b-chat-q3_K_L

492.5K Downloads Updated 1 year ago

Yi 1.5 is a high-performing, bilingual language model.

6b 9b 34b

ollama run yi:34b-chat-q3_K_L

curl http://localhost:11434/api/chat \
  -d '{
    "model": "yi:34b-chat-q3_K_L",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='yi:34b-chat-q3_K_L',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'yi:34b-chat-q3_K_L',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

9eb2e9e988e0 · 18GB ·

model

archllama

parameters34.4B

quantizationQ3_K_L

18GB

license

Yi Series Models Community License Agreement Version: 2.1 Date of Release: November 23, 2023 1. Defi

17kB

params

{ "num_ctx": 4096, "stop": [ "<|im_start|>", "<|im_end|>" ] }

74B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

106B

Readme

Yi is a series of large language models trained on a high-quality corpus of 3 trillion tokens that support both the English and Chinese languages.

References

HuggingFace