mistral-large:123b-instruct-2407-q6

mistral-large:123b-instruct-2407-q6_K

461.4K Downloads Updated 1 year ago

Mistral Large 2 is Mistral's new flagship model that is significantly more capable in code generation, mathematics, and reasoning with 128k context window and support for dozens of languages.

tools 123b

ollama run mistral-large:123b-instruct-2407-q6_K

curl http://localhost:11434/api/chat \
  -d '{
    "model": "mistral-large:123b-instruct-2407-q6_K",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='mistral-large:123b-instruct-2407-q6_K',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'mistral-large:123b-instruct-2407-q6_K',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

5e4615a812a8 · 101GB ·

model

archllama

parameters123B

quantizationQ6_K

101GB

template

{{- if .Messages }} {{- range $index, $_ := .Messages }} {{- if eq .Role "user" }} {{- if and (le (l

892B

license

# Mistral AI Research License If You want to use a Mistral Model, a Derivative or an Output for any

11kB

params

{ "stop": [ "[INST]", "[/INST]" ] }

30B

Readme

Mistral-Large-Instruct-2411 is an advanced dense Large Language Model (LLM) of 123B parameters with state-of-the-art reasoning, knowledge and coding capabilities.

Key features

Multi-lingual by design: Dozens of languages supported, including English, French, German, Spanish, Italian, Chinese, Japanese, Korean, Portuguese, Dutch and Polish.
Proficient in coding: Trained on 80+ coding languages such as Python, Java, C, C++, JavacScript, and Bash. Also trained on more specific languages such as Swift and Fortran.
Agentic-centric: Best-in-class agentic capabilities with native function calling and JSON outputting.
Advanced Reasoning: State-of-the-art mathematical and reasoning capabilities.
Mistral Research License: Allows usage and modification for research and non-commercial usages.
Large Context: A large 128k context window.

References

Blog post

Hugging Face