DIY GPU Machines
Hello! Starting with this installment, we move on to the software side of turning our GPU machine into an AI machine. The goal is to get the GPU working under Ubuntu and, ultimately, to reach the point where we can run inference with an LLM. 1. Creating a Ubuntu Installation
AI Mathematics
Good morning! This is the Qualiteg Research Department. In this installment, we will derive cross-entropy from the likelihood function. Chapter 4: Deriving Cross-Entropy from the Likelihood Function So far, we rolled a die 20 times, counted the events that occurred (whether the result was 1, 2, ..., or 6), and summarized
DIY GPU Machines
We are now in the final stretch of the build. Let's keep going! 1. Connect the motherboard power cable The 24-pin ATX cable is the one with the largest bundle of wires. First, plug it into the connector labeled M/B on the power supply side. Next, plug
Daily Dev Tips
When building LLM services, we often need to move an LLM that has already been downloaded once to a different server. (When you want to use the same LLM model on servers with an identical configuration, this is faster than downloading it again from Hugging Face, for example.) When a
AI Mathematics
Good morning. This is the Qualiteg Research Department. Let's pick up right where we left off last time. Chapter 2: Interpreting Classification as Predicting Probabilities In the classification problems we want to solve with deep learning, logistic regression, and so on, we predict which class an input belongs
DIY GPU Machines
This time, we finally install the star of the show: the graphics card. 1. Remove the PCI Express slot covers The graphics card goes into the PCI Express Gen 5 x16 slot, so we remove the cover for that position. Also, this graphics card occupies 4 slots, so we remove
DIY GPU Machines
This time, we will mount the motherboard in the case and take care of the various cable connections. 1. Fit the standoff screws The case comes with what are called standoff screws (spacers). We will screw these into the case. The standoffs are there to hold the motherboard in place
AI Mathematics
Good morning from the Qualiteg Research Department. Starting today, we would like to take a thorough look at cross-entropy. Are there two formulas for the cross-entropy function? In this series, we take up the cross-entropy function, which is commonly used as the loss function for classification problems in machine learning.
Daily Dev Tips
Hello from the Qualiteg Product Development Department. Today we would like to introduce a way to deal with the fragmented-token problem that often comes up during inference. In the incremental generation used for streaming chat, text is generated one token at a time. A token, however, is neither a "
DIY GPU Machines
In this installment, we set up the motherboard and its main components. 1. Unboxing the Motherboard The motherboard we purchased this time is the ASRock Z690 Steel Legend WiFi 6E/D5. Let's open it up right away. When you open the box, the cables and manuals are stored
AI Mathematics
Good morning. This is the Research Team at Qualiteg. Today we present the second half of our discussion on differentiating logarithmic functions. By the end of this installment, you should have a solid grasp of how to differentiate logarithmic functions. 2. Logarithm Identities First, let's review the basic
DIY GPU Machines
Yesterday I went to Akihabara and bought a total of about 415,000 yen worth of parts for a GPU machine, so here is a report. GPU Machine Parts * Motherboard: ASRock Z690 Steel Legend approx. 40,000 yen * Memory: Crucial desktop DDR5 32GB x 2 = approx. 30,000 yen * CPU:
![[ChatStream] ChatPrompt for rinna/nekomata-14b-instruction](/content/images/size/w600/2024/04/ChatPrompt--3-.png)
ChatStream Guide
In this article we introduce a ChatPrompt for rinna/nekomata-14b-instruction, which was released on December 21, 2023. The nekomata series is based on Qwen and has a vocabulary size of 152,000, considerably larger than earlier models, so we have high expectations for its Japanese language capabilities. This time we
DIY GPU Machines
Today it's time to buy the power supply, SSD, and case. Jun here. Once I pick up the power supply, SSD, and case, I should have everything I need. Let me take another look at the note that was left for me. (6) SSD: 1 TB or larger.
AI Mathematics
Good morning from the Qualiteg Research Team. Starting today, we will spend two articles learning about logarithmic functions. To be precise, we will learn how to differentiate logarithmic functions. What was a logarithmic function again? First of all, a logarithm is a way of finding "how many times a
DIY GPU Machines
This time, let's consider whether consumer GPUs can be used for serious AI computation, and how they differ from professional GPUs, with a few comparisons along the way. For an AI startup like ours (and not only startups), there are three scenarios in which we use GPUs. 1.