LLM Security
Introduction With the rapid evolution of artificial intelligence, large language models (LLMs) have become indispensable tools for many companies and organizations. Their range of applications—natural language processing, code generation, data analysis, and more—expands daily, driving innovation across a wide range of fields, from streamlining business processes to supporting
Daily Dev Tips
Hello! When working with ONNX Runtime, you may run into an error like the following [E:onnxruntime:Default, provider_bridge_ort.cc:1744 TryGetProviderInfo_CUDA] Failed to load library libonnxruntime_providers_cuda.so with error: libcublasLt.so.11: cannot open shared object file: No such file or directory [W:onnxruntime:
![[LLM Security] How to Detect Hallucinations](https://images.unsplash.com/photo-1488272690691-2636704d6000?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3wxMTc3M3wwfDF8c2VhcmNofDI5fHxoYWNrZXJ8ZW58MHx8fHwxNzIyOTA1NTE5fDA&ixlib=rb-4.0.3&q=80&w=600)
LLM Security
Hello, this is the Qualiteg Research Team. Today, we walk through the following paper on hallucination detection in RAG systems and share our thoughts on LLMs built specifically to detect hallucinations. "Lynx: An Open Source Hallucination Evaluation Model" https://arxiv.org/pdf/2407.08488 Overview The paper describes
AI-Business
Hello to everyone visiting the Qualiteg blog — I'm Michele. Working on AI-driven new business development and marketing, I often receive similar questions from clients. Through this blog, I would like to share my own answers to the challenges that anyone considering AI-powered business ventures is likely to face.
Blog
Hello! Today we take a look at domain-specific LLMs. In recent years, large language models (LLMs) have advanced at a remarkable pace. While general-purpose AI such as GPT-4o and Claude 3.5 draws much of the attention, demand for LLMs specialized for particular fields and use cases is growing rapidly.
LLM
On July 23, 2024, Meta announced its latest large language models, the Llama 3.1 series. In this article, we introduce the features and performance of the Llama 3.1 series, along with a hands-on look at using it. We have also covered this topic in the video below, so
AI-Business
Hello to everyone visiting the Qualiteg blog — this is Michele. In my work on AI-driven new business development and marketing, there are questions I hear from clients again and again. Through this blog, I would like to offer my own answers to the challenges that anyone exploring AI-powered business development
LLM
Hello. In this post we introduce "Mistral NeMo 12B," the latest LLM from Mistral AI, released on July 19, 2024. We will walk through the model's features and performance, and then try it out in an actual chat session using ChatStream. What Is Mistral NeMo 12B?
LLM
Today we tried out "mistralai/mamba-codestral-7B-v0.1" (commonly known as Codestral Mamba 7B), a new code-generation LLM released on July 16, 2024. This model adopts the new Mamba architecture and is published under the Apache 2 license. Performance Approaching SOTA Code-Generation Models Although Codestral 7B is built on
AI-Business
Hello to everyone visiting the Qualiteg blog — this is Michele. In my work on AI-driven new business development and marketing, there are questions I hear from clients again and again. Through this blog, I would like to offer my own answers to the challenges that anyone exploring AI-powered business development
News
Qualiteg Inc. ("we" or "the Company") is pleased to announce that we have been selected as an exhibitor in the Tokyo Business Frontier Pavilion at "Sangyo Koryuten (Industrial Trade Fair) 2024," one of the largest exhibitions for small and medium-sized enterprises in the Greater
Blog
Introduction In recent years, the rapid advancement of large language models (LLMs) has dramatically expanded what AI can do. Development of AI characters powered by these LLMs is now underway around the world, and the creation of characters capable of far more natural, intelligent conversation than conventional AI is becoming
IT & AI Technology
Hello, this is the Product Development Department at Qualiteg. When a new model is released, we often go hunting for the right recipe to speed up inference — quantizing with various techniques and switching between multiple inference engines. In the course of that work, we ran into the following issue. Since
ChatStream
Hello, this is the Product Development Department at Qualiteg. Today we present a first-look report on CyberAgentLM3-22B-Chat (cyberagent/calm3-22b-chat), the latest LLM from CyberAgent, announced in yesterday's press release. Demo You can actually try chatting with calm3-22b-chat at the following site: https://chatstream.net/?ws_name=chat_app&
![[ChatStream] GPU Server Configurations for Large-Scale LLM Inference](/content/images/size/w600/2024/07/20240704_-ChatStream-----LLM---_.png)
In this video, we take a detailed look at the GPU server configurations required for inference with large-scale LLMs (large language models) and how they work together with ChatStream. Using the Llama3-70B model as an example, we explain its memory requirements (140 GB of GPU memory) and the GPU server
Daily Dev Tips
When you encounter an error like the following: RuntimeError: implement_array_function method already has a docstring This error message appears to stem from a problem inside the numpy package. Specifically, the error says that the implement_array_function method already has documentation attached, and it typically seems to occur