![[Explainer] What Is the Tekken Tokenizer? Inside the New-Generation Tokenizer Adopted by Mistral](/content/images/size/w600/2025/02/DALL-E-2025-02-12-10.17.55---A-photorealistic-image-of-a-gladiator-holding-a-sword.-The-gladiator-is-wearing-traditional-Roman-armor-with-a-helmet--chest-plate--and-a-short-tunic.webp)
LLM
Hello! Today we are going to talk about Tekken! When you hear "Tekken," what comes to mind? The fighting game Tekken (鉄拳, "iron fist"), perhaps? Personally, I thought of the Long Swordsman (鉄剣戦士, "iron-sword warrior" in the Japanese edition) from Age of Empires, a
LLM
Hello! On January 30, 2025, Mistral AI announced its new language model, Mistral Small v3. Despite a relatively small parameter count of 24B, the model achieves performance comparable to large-scale models of 70B or more. It also advertises Japanese-language support, making it a highly anticipated compact model. https://huggingface.co/
![[vLLM] How to Fix "To use CUDA with multiprocessing, you must use the 'spawn' start method"](https://images.unsplash.com/photo-1597872200969-2b65d56bd16b?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3wxMTc3M3wwfDF8c2VhcmNofDh8fGdwdXxlbnwwfHx8fDE3MzkyMzYxNTh8MA&ixlib=rb-4.0.3&q=80&w=600)
LLM
When using vLLM on WSL and trying to serve a single LLM across multiple GPUs with tensor parallelism, you will often run into an error like the following. RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method A
LLM
Hello! The "Deep Research" scene has suddenly been heating up. Today, we dive into Open Deep Research—announced just yesterday (February 5, 2025)—and walk through its architecture and implementation! 1. Introduction OpenAI's "GPT Deep Research" has been making waves, and it seems likely
ChatStream Guide
chatstream.net is a service operated by Qualiteg Inc. that lets you try out the latest publicly available LLMs from around the world as soon as they are released. You can open a particular LLM for an in-depth chat, open several LLMs and use them together, or have LLMs compare
LLM
On July 23, 2024, Meta announced its latest large language models, the Llama 3.1 series. In this article, we introduce the features and performance of the Llama 3.1 series, along with a hands-on look at using it. We have also covered this topic in the video below, so
LLM
Hello. In this post we introduce "Mistral NeMo 12B," the latest LLM from Mistral AI, released on July 19, 2024. We will walk through the model's features and performance, and then try it out in an actual chat session using ChatStream. What Is Mistral NeMo 12B?
LLM
Today we tried out "mistralai/mamba-codestral-7B-v0.1" (commonly known as Codestral Mamba 7B), a new code-generation LLM released on July 16, 2024. This model adopts the new Mamba architecture and is published under the Apache 2 license. Performance Approaching SOTA Code-Generation Models Although Codestral 7B is built on
IT & AI Technology
Hello, this is the Product Development Department at Qualiteg. When a new model is released, we often go hunting for the right recipe to speed up inference — quantizing with various techniques and switching between multiple inference engines. In the course of that work, we ran into the following issue. Since
ChatStream
Hello! Today we tried out Llama-3-Elyza-JP-8B. Announced just yesterday, on June 26, 2024 (https://prtimes.jp/main/html/rd/p/000000046.000047565.html), Llama-3-Elyza-JP-8B is a Japanese LLM whose 70B version is reported to outperform GPT-4. In this post, we share our experience loading Llama-3-Elyza-JP-8B into our own Playground environment
IT & AI Technology
Hello! This is the Qualiteg Tech Blog. [Updated July 2, 2024] Today we will cover the features and pricing of the Google Gemini 1.5 Pro / Gemini 1.5 Flash models, and how to generate text with them using Python. What is Google Gemini? Google Gemini is a generative AI