Painting with a Database

Let’s paint with a database and your imagination. | Continue reading


@pingcap.com | 1 year ago

Simplify Database Geo-Redundancy Backup with Cloud Storage Services

There can be challenges in scalability, operations, and costs to achieve geo-redundancy with databases. And an answer to these challenges is cloud storage service. | Continue reading


@pingcap.com | 1 year ago

Troubleshooting Memory Leaks: Deep Dive into Common Heap Profilers

Heap profilers are powerful runtime tools to pinpoint memory leak issues in applications. This post describes how some common heap profilers are used and implemented. | Continue reading


@pingcap.com | 1 year ago

Streaming, Pipelining, and Parallelization

This post introduces why we should use streaming, pipelining, and parallelization to build high throughput applications. | Continue reading


@pingcap.com | 1 year ago

WebAssembly Powers Databases: Build a UDF Engine with WASM

WebAssembly is a binary instruction format designed for secure and near-native execution in the sandboxed environment. This post shares how we use WebAssembly to build a user-defined function engine for TiDB. | Continue reading


@pingcap.com | 2 years ago

The Benefits of an HTAP Database

Hybrid Transactional and Analytical Processing, or HTAP, is a defining feature of TiDB. It means that you can run both transactional and analytical queries from within the same database. TiDB provides HTAP, ensuring that your queries are always running against the most current da … | Continue reading


@pingcap.com | 2 years ago

How China's Twitch Scales Out Databases and Gets Big Data Queries 6x Faster

As Huya Live's business grew, their storage capacity became a bottleneck. Their live broadcasts had high latency, and their database maintenance cost was high. Learn how TiDB helps them achieve database scalability, high availability, and strong consistency with low costs. | Continue reading


@pingcap.com | 2 years ago

How Pinterest Reduced Costs and Improved Data Consistency with a NewSQL Database

Pinterest used the HBase ecosystem for their data storage. But this infrastructure was complex, with limited functionalities and high maintenance costs. They switched to TiDB over YugaByteDB and CockroachDB because it best met their requirements for stability and performance. | Continue reading


@pingcap.com | 2 years ago

Raft and High Availability

Raft is a consensus-based method that distributes data in such a way that it creates and maintains a high availability environment for your database. This article introduces the general components and mechanisms of Raft, and how distributed databases such as TiDB and TiKV use Raf … | Continue reading


@pingcap.com | 2 years ago

TiDB 5.2: Translytical Processing Made Easier and Faster

We are proud to announce our the release of TiDB 5.2. TiDB 5.2 focuses on real-world scenarios, aiming to push the boundaries of transactional and analytical processing even further to meet the demands of massive, real-time data processing. | Continue reading


@pingcap.com | 2 years ago

A MySQL Alternative, Scale-Out Database Helps Xiaomi's Hyper Growth

Xiaomi is a world-leading consumer electronics company. When MySQL no longer met their business needs, they migrated to TiDB for its scalability, high availability, and HTAP performance. | Continue reading


@pingcap.com | 2 years ago

Securing Online Gaming: Combine Chaos Engineering with DevOps Practices

Tencent Interactive Entertainment Group is known as the publisher of some of the most popular video games. This article shares why and how they use chaos engineering in their DevOps workflow. | Continue reading


@pingcap.com | 2 years ago

How to Deploy TiDB on Google Cloud Platform–Part 2

This post shows how to install, configure, and run TiDB on a Google Cloud Platform instance. | Continue reading


@pingcap.com | 2 years ago

Flink on TiDB: Reliable, Convenient Real-Time Data Service

Combining Flink and TiDB provide powerful support for real-time data processing. In this article, a NetEase senior engineer introduces how they use Flink on TiDB to guarantee end-to-end exactly-once semantics. | Continue reading


@pingcap.com | 2 years ago

TiDB 5.1: Easily Build Your Mission-Critical Applications at Any Scale

TiDB 5.1 is released. It features more stable latency, optimized MPP performance and stability, and more convenient maintenance. Developers and DBAs can more easily build mission-critical applications at any scale. | Continue reading


@pingcap.com | 2 years ago

Managing Your Data Lifecycle with Time to Live Tables

Time to live, or TTL, is a mechanism to manage the data lifecycle in a system. At TiDB Hackathon 2020, a team introduced TTL tables into TiDB to enable automatic management of the data lifecycle. | Continue reading


@pingcap.com | 2 years ago

TiDB 5.0: A One-Stop HTAP Database Solution

TiDB 5.0 features a comprehensive HTAP solution enhanced by an MPP analytical query engine. This article introduces the new TiDB 5.0 HTAP architecture and how TiDB 5.0 serves various transactional & analytical hybrid workload scenarios. | Continue reading


@pingcap.com | 2 years ago

TiDB Cloud Now in Public Preview

We are excited to announce the public preview of TiDB Cloud, the fully-managed TiDB service by PingCAP. With TiDB Cloud, customers can now easily use TiDB on Amazon Web Services and Google Cloud to quickly build modern, mission critical applications. | Continue reading


@pingcap.com | 2 years ago

Choose a MySQL Alternative over Vitess and CRDB to Scale Out Our Database on K8s

Ninja Van is a leading logistics company in Southeast Asia. They chose TiDB over Vitess and CockroachDB to scale out their databases on Kubernetes. | Continue reading


@pingcap.com | 2 years ago

Tide: Developing a Distributed Database in a Breeze

TiDE is a VS Code extension for developing TiDB. It offers IDE, debugging, log search, Kubernetes integration, and VM management for TiDB clusters. | Continue reading


@pingcap.com | 2 years ago

TiKV and SPDK: Pushing the Limits of Storage Performance

By introducing SPDK into TiKV, we enable the database to directly send instructions to NVMe disks, reducing read/write latency significantly. | Continue reading


@pingcap.com | 2 years ago

Using a GPU Boosts Analytics Performance by 10 to 150 Times

At TiDB Hackathon 2020, a team used GPU acceleration techniques to improve the performance of CPU-intensive analytical query processing and achieved 10x~150x performance improvement. | Continue reading


@pingcap.com | 3 years ago

Empower Your Business with Big Data and Real-Time Analytics in TiDB

Big data is a growing need for ambitious companies. Learn the usage, cost, and technology selection of real-time big data analytics and how TiDB prevails over other solutions. | Continue reading


@pingcap.com | 3 years ago

Reducing Cross-AZ Data Transfer Costs by 89%

At TiDB Hackathon 2020, the Pingtouge team focused on reducing TiDB's cross-AZ data transfer costs on the cloud. They managed to reduce read traffic by 89% and write traffic by 15%. | Continue reading


@pingcap.com | 3 years ago

TiDB on an ARM-Based Kubernetes Cluster: x86 Performance at 15% Lower Cost

Running TiDB on EKS clusters with Graviton processors offers performance comparable to an x86-based cluster, but at a 15% saving. This article discusses the benchmark tests we ran. | Continue reading


@pingcap.com | 3 years ago

How to Efficiently Choose the Right Database for Your Applications

Learn how to efficiently find the right database for your applications. | Continue reading


@pingcap.com | 3 years ago

We Use a MySQL Alternative to Avoid Sharding and Provide Strong Consistency

Meituan is the largest local life service company in China. As their business expanded, Meituan chose TiDB as a MySQL alternative to solve the difficulty of manual sharding and provide strong consistency. | Continue reading


@pingcap.com | 3 years ago

TiGraph: 8,700x Computing Performance Achieved by Graphs and the RDBMS Syntax

TiGraph can manipulate graph data and relational data in one transaction while guaranteeing strong consistency. It boosts TiDB's computing performance by 8,700x in four-degree separation. | Continue reading


@pingcap.com | 3 years ago

Linux Kernel vs. Memory Fragmentation

This post introduces common methods to prevent Linux memory fragmentation, the principle of memory compaction, how to view the fragmentation index, etc. | Continue reading


@pingcap.com | 3 years ago

Five Principles That Guide TiDB and PingCAP (Part I)

PingCAP's CEO talks about the philosophy of TiDB's evolution and how PingCAP built TiDB in the past five years. | Continue reading


@pingcap.com | 3 years ago

No Sharding, No ETL: Use a Scale-Out MySQL Alternative to Store 160 TB of Data

As 58.com's business quickly grew, they encountered a database bottleneck. To scale out their databases and simplify database maintenance, they migrated from MySQL to TiDB, a highly available MySQL alternative. | Continue reading


@pingcap.com | 3 years ago

Deliver Real-Time Analytics and True HTAP by Combining Columnstore and Rowstore

TiDB is an HTAP database that targets both OLTP and OLAP scenarios. TiFlash is its extended analytical engine. This post introduces how TiFlash fuels TiDB to become a true HTAP database that lets users perform real-time analytics. | Continue reading


@pingcap.com | 3 years ago

Why Benchmarking Distributed Databases Is So Hard

Benchmarks are hard to get right, and many articles touting benchmarks are actually benchmarketing, showcasing skewed outcomes to sell products. This post introduces some of the motivations for benchmarking and the common tools, and discusses a few things to keep in mind when ben … | Continue reading


@pingcap.com | 3 years ago

Design Golang Failpoints to Improve System Fault Tolerance and Stability

This post introduces design and implementation of Golang Failpoint. | Continue reading


@pingcap.com | 3 years ago

We Found a Data Corruption Bug in RocksDB

Data was corrupted. A cluster panicked. The crime scene was compromised. What happened? Detective Huang went all lengths to locate the criminal and solved it once and for all. | Continue reading


@pingcap.com | 3 years ago

The Design and Implementation of Multi-Raft

The goal of TiKV is to support 100 TB+ data and it is impossible for one Raft group to make it, we need to use multiple Raft groups, which is called Multi-raft. | Continue reading


@pingcap.com | 3 years ago

Simulating Clock Skew in K8s Without Affecting Other Containers on the Node

As a cloud-native chaos engineering platform, Chaos Mesh supports TimeChaos, which simulates clock skew in containers or K8s for distributed systems to test system robustness, without affecting other containers on the node. | Continue reading


@pingcap.com | 3 years ago

A 3x IT Efficiency Boost: Use a Scale-Out Database for Near Real-Time Analytics

As its business quickly grew, ZTO Express found Exadata, Kudu, and HBase couldn't meet their database requirements. To scale out their database and perform multi-dimensional analytics in near real time, they migrated from Oracle Exadata to TiDB. | Continue reading


@pingcap.com | 3 years ago

Gaining 3x Throughput by Migrating from Aurora to a Scale-Out MySQL Alternative

PayPay is Japan's largest mobile payment company. Learn how they achieved 3x throughput by migrating from Aurora to TiDB, a scale-out MySQL alternative. | Continue reading


@pingcap.com | 3 years ago

Why We Switched from BCC to Libbpf for Linux BPF Performance Analysis

Libbpf + BPF CO-RE is better than BCC. It greatly reduces storage space and runtime overhead, and it improves programmers' deployment and development experience. | Continue reading


@pingcap.com | 3 years ago

Tips and Tricks for Writing Linux BPF Applications with Libbpf

Compared to BCC, the libbpf + BPF CO-RE solution greatly reduces storage space and runtime overhead. That's why we switched from bcc-tools to libbpf-tools. This post introduces some tips and tricks for writing BPF applications with libbpf. | Continue reading


@pingcap.com | 3 years ago

How THP Slows Down Your Database Performance and What to Do about It

This post dives deep into how transparent huge pages (THP) slow down the system and explains why you should disable THP to improve your database performance. | Continue reading


@pingcap.com | 3 years ago

China's Insurance Giant Improved Agile App Performance by a NewSQL Database

Ping An Life Insurance shares a case where TiDB helped them support 100 billion RMB payment volume in a single day, the pain points before they used TiDB, how they use TiDB, and why they chose TiDB. | Continue reading


@pingcap.com | 3 years ago

Why We Switched from bcc-tools to libbpf-tools for BPF Performance Analysis

Libbpf + BPF CO-RE is better than BCC. It greatly reduces storage space and runtime overhead, and it improves programmers' deployment and development experience. | Continue reading


@pingcap.com | 3 years ago

We Reduced Our Batch Processing Time by About 58% with a Scale-Out Database

WeBank is China's first privately-owned Internet bank. As they grew, they encountered database performance and capacity bottlenecks. By using TiDB, a scale-out MySQL alternative, they reduced their batch processing time by ~58%. | Continue reading


@pingcap.com | 3 years ago

How to Run a Database on AWS with Better Performance and Lower Cost

This article illustrates the best practices of running TiDB on AWS, including how to choose the suitable cloud storage and properly configure the system. | Continue reading


@pingcap.com | 3 years ago

PingCAP, the Company Behind TiDB, Raises $270M in Series D Funding

With great pleasure, we are announcing that we have raised $270 million in Series D funding led by global investors. We are looking for more innovations, global expansion, and more team growth as we strive to build the database of the future. | Continue reading


@pingcap.com | 3 years ago

TiDB on KubeSphere: A Cloud-Native Distributed DB on a Hybrid-Cloud K8s Platform

A site reliability engineer gives a step-by-step tutorial on how to deploy TiDB on KubeSphere, an open-source, distributed GUI operating system with Kubernetes as its kernel. | Continue reading


@pingcap.com | 3 years ago