Qualiteg Research Team

How to Talk Honestly About PII Detection Accuracy: Evaluation Design Through Recall, Confidence Intervals, and Representativeness

AI Mathematics

How to Talk Honestly About PII Detection Accuracy: Evaluation Design Through Recall, Confidence Intervals, and Representativeness

Hello. This is the Qualiteg Research Team. We work on technology for detecting and masking sensitive information — personal information (PII), confidential information, and special-care-required personal data (https://pii-fi.com). In that work, the question we face every day is: 「how can we talk about accuracy figures honestly and correctly」 ? Suppose,

By Qualiteg Research Team
What the Confusion Matrix Doesn't Show in PII Detection: Cross-Recognizer Collisions and Integration Testing

LLM Security

What the Confusion Matrix Doesn't Show in PII Detection: Cross-Recognizer Collisions and Integration Testing

Hello! This is the Qualiteg Research Team. Automatic detection of personally identifiable information (PII) can be framed as the problem of extracting specific expressions from text and determining which type of PII each one represents. As the range of PII types to detect grows — phone numbers, personal names, account numbers,

By Qualiteg Research Team, Qualiteg AI Security Team
LLM-Audit PII Detection Technology, Part 1: High-Accuracy PII Detection Attuned to the Depth of the Japanese Language

LLM-Audit

LLM-Audit PII Detection Technology, Part 1: High-Accuracy PII Detection Attuned to the Depth of the Japanese Language

Hello from the Qualiteg Research Team! Today we take a close look at PII (Personally Identifiable Information) detection technology. Global Tools and Japanese-Specialized Tools, Side by Side Protecting personal information is a challenge shared worldwide. With regulations tightening around the globe—GDPR, CCPA, and Japan's amended Act on

By Qualiteg Research Team