第三届中国 Rust 开发者大会 基于 Rust Arrow Flight 的物联网和时序数据传输及 转换工具 霍琳贺 涛思数据 Rust China Conf 2023 CONTENTS 自 我 介 绍 T D e n g i n e t a o s X R u s t 使 用 TDengine Rust • OOXML - Excel 解析库 • xlsx2csv - "expr": "field1.contains(\"abc\")", "as": "bool"}}} • Mutate • Filter • Pivot Powered by serde + arrow taosX - 数据汇聚 CONTENTS 自 我 介 绍 T D e n g i n e t a o s X R u s t 使 用 Why Rust ? • 安全性 • 高性能 https://crates.io/crates/arrow-flight https://crates.io/crates/tonic • Authentication: https://crates.io/crates/jsonwebtoken • Data structure: • Arrow: https://crates.io/crates/arrow • Parquet: https://crates

tool with Apache Arrow, Parquet and DataFusion 朱霜 2023.06.18 1. Introduction 2. Duo - Observability duet: Logging and Tracing • What is Duo? • How does it work? 3. Apache Arrow, Parquet and DataFusion DataFusion • A brief introduction to Arrow, Parquet, and DataFusion • How does Duo store and query log, span data? 4. The vision of Duo Content Introduction • ID: Folyd • GitHub: @folyd • 博客: https://folyd Logging and Tracing Duo - How does it work? Duo - How does it work? Apache Arrow, Parquet, and DataFusion Apache Arrow • Created by Wes McKinney, creator of Pandas (2016) • A language-independent

message between two participants. Participants do not have to be explicitly declared. To have a dotted arrow, you use --> It is also possible to use <- and <--. That does not change the drawing, but may improve 5 Change arrow style You can change arrow style by several ways: • add a final x to denote a lost message • use \ or / instead of < or > to • have only the bottom or top part of the arrow • repeat repeat the arrow head (for example, >> or //) head to have a thin drawing PlantUML Language Reference Guide (1.2019.4) 3 / 166 1.6 Change arrow color 1 SEQUENCE DIAGRAM • use -- instead of - to have a dotted

message between two participants. Participants do not have to be explicitly declared. To have a dotted arrow, you use --> It is also possible to use <- and <--. That does not change the drawing, but may improve 5 Change arrow style You can change arrow style by several ways: • add a final x to denote a lost message • use \ or / instead of < or > to • have only the bottom or top part of the arrow • repeat repeat the arrow head (for example, >> or //) head to have a thin drawing PlantUML Language Reference Guide (1.2019.3) 3 / 158 1.6 Change arrow color 1 SEQUENCE DIAGRAM • use -- instead of - to have a dotted

message between two participants. Participants do not have to be explicitly declared. To have a dotted arrow, you use --> It is also possible to use <- and <--. That does not change the drawing, but may improve 5 Change arrow style You can change arrow style by several ways: • add a final x to denote a lost message • use \ or / instead of < or > to • have only the bottom or top part of the arrow • repeat repeat the arrow head (for example, >> or //) head to have a thin drawing PlantUML Language Reference Guide (1.2019.1) 3 / 147 1.6 Change arrow color 1 SEQUENCE DIAGRAM • use -- instead of - to have a dotted

message between two participants. Participants do not have to be explicitly declared. To have a dotted arrow, you use --> It is also possible to use <- and <--. That does not change the drawing, but may improve 5 Change arrow style You can change arrow style by several ways: • add a final x to denote a lost message • use \ or / instead of < or > to • have only the bottom or top part of the arrow • repeat repeat the arrow head (for example, >> or //) head to have a thin drawing PlantUML Language Reference Guide (1.2019.2) 3 / 159 1.6 Change arrow color 1 SEQUENCE DIAGRAM • use -- instead of - to have a dotted

message between two participants. Participants do not have to be explicitly declared. To have a dotted arrow, you use --> It is also possible to use <- and <--. That does not change the drawing, but may improve 1.5 Change arrow style You can change arrow style by several ways: • add a final x to denote a lost message • use \ or / instead of < or > to have only the bottom or top part of the arrow • repeat the the arrow head (for example, >> or //) head to have a thin drawing • use -- instead of - to have a dotted arrow PlantUML Language Reference Guide (1.2019.9) 3 / 174 1.6 Change arrow color 1 SEQUENCE

message between two participants. Participants do not have to be explicitly declared. To have a dotted arrow, you use --> It is also possible to use <- and <--. That does not change the drawing, but may improve 5 Change arrow style You can change arrow style by several ways: • add a final x to denote a lost message • use \ or / instead of < or > to • have only the bottom or top part of the arrow • repeat repeat the arrow head (for example, >> or //) head to have a thin drawing PlantUML Language Reference Guide (1.2019.6) 3 / 173 1.6 Change arrow color 1 SEQUENCE DIAGRAM • use -- instead of - to have a dotted

link actors and use cases, the arrow --> is used. The more dashes - in the arrow, the longer the arrow. You can add a label on the arrow, by adding a : character in the arrow definition. In this example (Use case 2) <- :user: @enduml It is also possible to change arrow direction by adding left, right, up or down keywords inside the arrow: @startuml :user: -left-> (dummyLeft) :user: -right-> (dummyRight) @enduml PlantUML 언어참조가이드 (1.2019.2) 29 / 157 2.9 Splitting diagrams 2 유즈케이스다이어그램 You can shorten the arrow by using only the first character of the direction (for example, -d- instead of -down-) or the two

link actors and use cases, the arrow --> is used. The more dashes - in the arrow, the longer the arrow. You can add a label on the arrow, by adding a : character in the arrow definition. In this example (Use case 2) <- :user: @enduml It is also possible to change arrow direction by adding left, right, up or down keywords inside the arrow: @startuml :user: -left-> (dummyLeft) :user: -right-> (dummyRight) @enduml PlantUML 언어참조가이드 (1.2019.4) 29 / 165 2.9 Splitting diagrams 2 유즈케이스다이어그램 You can shorten the arrow by using only the first character of the direction (for example, -d- instead of -down-) or the two