HBase Practice At Xiaomi huzheng@xiaomi.com About This Talk ● Async HBase Client ○ Why Async HBase Client ○ Implementation ○ Performance ● How do we tuning G1GC for HBase ○ CMS vs G1 ○ Tuning Tuning G1GC ○ G1GC in XiaoMi HBase Cluster Part-1 Async HBase Client Why Async HBase Client ? Request-1 Response-1 Request-2 Response-2 Request-3 Response-3 Request-4 Response-4 Request-1 Other AbstractRpcClient Performance Test ○ Test Async RPC by CompletableFuture.get() (Based on XiaoMi HBase0.98) ○ Proof that latency of async client is at least the same as blocking hbase client.

HBase Practice At XiaoMi tianjy1990@gmail.com openinx@apache.org Part-1 Problems In Practice Problems in XiaoMi ❏ Problem 1. How to satisfy the regular demand of scanning table without affecting Snapshot ‘ns1:test’ HdfsAclManager Has ACL config? Grant read access Snapshot Manifest Problems in XiaoMi ❏ Problem 2. How to prevent data from being contaminated or lost when user operate incorrectly ❏ Delete snapshot regularly ❏ Verify the backups on the heterogeneous fileSystem Problems in XiaoMi ❏ Problem 3. Restart of a small cluster is stuck at log splitting Why stuck at splitting ❏ HBASE-19358

895 2257 197 15 Juejin 1372.4099310206000 25 3819 15 Juejin 647 747 5242 636 16 Xiaomi 1177.3574228246100 74 893 16 Xiaomi 583 674 651 565 17 CTrip 964.1939061432820 39 2039 17 CTrip 308 357 562 290 18 895 2257 197 15 Juejin 1372.4099310206000 25 3819 15 Juejin 647 747 5242 636 16 Xiaomi 1177.3574228246100 74 893 16 Xiaomi 583 674 651 565 17 CTrip 964.1939061432820 39 2039 17 CTrip 308 357 562 290 18

is basically not involved in heap memory allocations. However, in our performance test at XiaoMi, we found that ​the 100% Get case is still seriously affected by Young GC​: Picture.1 QPS

6GHz i3-10100 的 水平，下一步争取使用成熟工艺达到英特尔、AMD 先进工艺 CPU 的性能。 龙芯 3A6000 桌面处理器正式发布 中国开发者团队创建编程语言 小米澎湃 OS（Xiaomi HyperOS） 是小米推出的全新的操作系统，基 于深度进化的 Android 以及自研 的 Vela 系统融合，彻底重写底层 架构。 雷军介绍称，小米澎湃 OS 打造了 贯穿内核层、服务框架层、跨端层

2331 14 Netease 1546.7604242230700 144 3350 15 Juejin 1372.4099310206000 25 3819 16 Xiaomi 1177.3574228246100 74 893 17 CTrip 964.1939061432820 39 2039 18 Bilibili 955.5404317482340