yi:6b-chat-q2

yi:6b-chat-q2_K

492K Downloads Updated 1 year ago

Yi 1.5 is a high-performing, bilingual language model.

6b 9b 34b

ollama run yi:6b-chat-q2_K

curl http://localhost:11434/api/chat \
  -d '{
    "model": "yi:6b-chat-q2_K",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='yi:6b-chat-q2_K',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'yi:6b-chat-q2_K',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

cb2cf6916ce2 · 2.6GB ·

model

archllama

parameters6.06B

quantizationQ2_K

2.6GB

params

{ "stop": [ "<|im_start|>", "<|im_end|>" ] }

59B

license

Yi Series Models Community License Agreement Version: 2.1 Date of Release: November 23, 2023 1. Defi

17kB

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

106B

Readme

Yi is a series of large language models trained on a high-quality corpus of 3 trillion tokens that support both the English and Chinese languages.

References

HuggingFace