GPU

DIY GPU Machines

Building a GPU PC, Part 13: Connecting the Power Cables

We are now in the final stretch of the build. Let's keep going! 1. Connect the motherboard power cable The 24-pin ATX cable is the one with the largest bundle of wires. First, plug it into the connector labeled M/B on the power supply side. Next, plug

DIY GPU Machines

Building a GPU PC, Part 12: Installing the Graphics Card on the Motherboard

This time, we finally install the star of the show: the graphics card. 1. Remove the PCI Express slot covers The graphics card goes into the PCI Express Gen 5 x16 slot, so we remove the cover for that position. Also, this graphics card occupies 4 slots, so we remove

DIY GPU Machines

Building a GPU PC, Part 11: Mounting the Motherboard and Wiring the Case

This time, we will mount the motherboard in the case and take care of the various cable connections. 1. Fit the standoff screws The case comes with what are called standoff screws (spacers). We will screw these into the case. The standoffs are there to hold the motherboard in place

DIY GPU Machines

Building a GPU PC, Part 10: Installing the CPU, Memory, and SSD on the Motherboard

In this installment, we set up the motherboard and its main components. 1. Unboxing the Motherboard The motherboard we purchased this time is the ASRock Z690 Steel Legend WiFi 6E/D5. Let's open it up right away. When you open the box, the cables and manuals are stored

DIY GPU Machines

Building a GPU PC, Part 9: Parts for an AI Research GPU Machine and Starting the Build

Yesterday I went to Akihabara and bought a total of about 415,000 yen worth of parts for a GPU machine, so here is a report. GPU Machine Parts * Motherboard: ASRock Z690 Steel Legend approx. 40,000 yen * Memory: Crucial desktop DDR5 32GB x 2 = approx. 30,000 yen * CPU:

DIY GPU Machines

Building a GPU PC, Part 8: Power Supply, SSD, and Case

Today it's time to buy the power supply, SSD, and case. Jun here. Once I pick up the power supply, SSD, and case, I should have everything I need. Let me take another look at the note that was left for me. (6) SSD: 1 TB or larger.

DIY GPU Machines

Building a GPU PC, Part 7-1: Column – The Difference Between Consumer and Professional GPUs

This time, let's consider whether consumer GPUs can be used for serious AI computation, and how they differ from professional GPUs, with a few comparisons along the way. For an AI startup like ours (and not only startups), there are three scenarios in which we use GPUs. 1.

ChatStream Guide

[ChatStream] The Queueing System and Concurrency Limits

Hello from the Product Development Department at Qualiteg Inc. In this article, we explain the queueing system in ChatStream. What Is the Queueing System? When ChatStream receives a large number of simultaneous access requests, it can queue those requests and limit the number of text generations that run at the

DIY GPU Machines

Building a GPU PC, Part 7: Choosing a GPU for AI

This time, we select a graphics board (GPU) suited to AI work. Before getting into the main story, let's sort out the difference between a graphics board and a GPU. A graphics board is a key piece of hardware that handles image processing and AI computation in a

DIY GPU Machines

Building a GPU PC, Part 6: Choosing Memory

This time, let's choose the memory and other peripheral parts. Memory selection has its own pitfalls, and Jun managed to fall right into one. Let's take a look. Phew. I finally managed to buy the CPU and the motherboard. What else do I need to buy?

DIY GPU Machines

Building a GPU PC, Part 5: Which Motherboard to Choose?

This time, we select the motherboard. Before we follow the rest of Jun's shopping trip, let's quickly review chipsets once more. Both 12th- and 13th-generation Intel Core CPUs use the LGA 1700 socket, and in many cases a 12th-generation chipset is also compatible with 13th-generation CPUs.

Blog

The GPU-Rich and the Reality in Japan

The global GPU shortage is becoming increasingly severe, and securing high-performance graphics processing units (GPUs) in particular has become difficult. This shortage is having a major impact on many technology industries, beginning with AI research and development, and is giving rise to a new form of competition among companies and

DIY GPU Machines

Building a GPU PC, Part 4: Off to Akihabara! Choosing a CPU

Hello, and welcome. Let's get started on building a PC. For this series, we asked Jun, a young engineer at Qualiteg, to share a candid, first-hand account of building a GPU machine from scratch. I'm Jun, a software engineer. One morning I arrived at the office

DIY GPU Machines

Building a GPU PC, Part 3: The Dream of Running Two Graphics Cards

Hello again. Today's topic is lane bifurcation and running two graphics cards. As we saw last time, on Intel Core series CPUs, the PCI Express connection coming directly from the CPU is PCIe Gen 5 x16 (16 lanes). PCIe Gen 5 is extremely fast, and since 16 of

DIY GPU Machines

Building a GPU PC, Part 2: How the CPU, Chipset, and PCI Express Relate

Hello! Today I would like to learn about the CPU and the chipset. Our ultimate goal is to build a GPU machine that can be used for AI development, but where exactly in a PC does the GPU go? The answer: it plugs into a PCI Express slot on the

DIY GPU Machines

Building a GPU PC, Part 1: Understanding Modern DIY PC Architecture

Before building a PC, I want to start by learning about the PC architecture of today, as of 2023. CPU, Motherboard, and Chipset Chipset A motherboard carries an important component called the "chipset," which manages communication between the various parts. Each chipset supports a fixed set of CPUs,