openchat:7b-v3.5-0106-q3_K

openchat:7b-v3.5-0106-q3_K_S

390.8K Downloads Updated 2 years ago

A family of open-source models trained on a wide variety of data, surpassing ChatGPT on various benchmarks. Updated to version 3.5-0106.

ollama run openchat:7b-v3.5-0106-q3_K_S

curl http://localhost:11434/api/chat \
  -d '{
    "model": "openchat:7b-v3.5-0106-q3_K_S",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='openchat:7b-v3.5-0106-q3_K_S',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'openchat:7b-v3.5-0106-q3_K_S',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

43be12a77c78 · 3.2GB ·

model

archllama

parameters7.24B

quantizationQ3_K_S

3.2GB

params

{ "stop": [ "<|endoftext|>", "<|end_of_turn|>" ] }

65B

license

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

template

{{ .System }}<|end_of_turn|>GPT4 Correct User: {{ .Prompt }}<|end_of_turn|>GPT4 Correct Assistant:

98B

Readme

OpenChat is set of open-source language models, fine-tuned with C-RLFT: a strategy inspired by offline reinforcement learning.

Updated to OpenChat-3.5-1210, this new version of the model model excels at coding tasks and scores very high on many open-source LLM benchmarks.

References

GitHub

HuggingFace