Inc. All rights Reserved. Kubernetes Operator for Massively Parallel Postgres Goutam Tadi (@goutamtadi) Senior Software Engineer, Pivotal Software Inc Email: gp-kubernetes@pivotal.io PGConf India 2019 2019 Agenda ● Intro to Greenplum ● Kubernetes 101 ● Greenplum for Kubernetes ○ Components ■ Greenplum Operator ■ Greenplum Cluster ● Demo Massively Parallel Postgres Greenplum Greenplum Data Data Platform ANALYTICAL APPLICATIONS NATIVE INTERFACES PIVOTAL GREENPLUM PLATFORM MULTI- STRUCTURED DATA SOURCES & PIPELINES Structured Data JDBC, ODBC SQL ANSI SQL FLEXIBLE DEPLOYMENT Local

Greenplum on Kubernetes 容器化MPP数据库 AGENDA 云数据库背景 云数据库实现方案 Greenplum on Kubernetes Greenplum Operator 总结 云数据库背景 云数据库背景 ● 资源变化 ○ 本地资源 → 云 ○ 静态资源 → 弹性需求 ● 数据变化 ○ 内部数据 → 多数据源 ○ 数据规模 → 不易预测 ○ 数据格式 ○ Vertica Eon Mode ● 容器化数据库+Kubernetes ○ Apache Spark ○ CockroachDB ○ Apache HAWQ 云数据库存储方案 ● 块存储 ○ 文件系统接口 ● 对象存储 ○ 成本低 ○ 扩展性强 ○ 访问延迟高 Greenplum on Kubernetes Network Interconnect Standby 容器化Greenplum存储管理 ○ 容器本地存储易失性 ○ 容器外部存储关联性 Kubernetes 容器网络管理 容器资源管理 容器镜像管理 容器调度 容器监控及自 定义操作 容器存储管理 Kubernetes 101 Kubernetes 101 Master组件 Node组件 Kubernetes存储资源 PV ● PersistentVolume ○ 表示一种存储资源，独立容器生命周期

6 Client and Loader Tools package for Windows does not support running the gpfdist program as a native Windows service. Removed Features Pivotal Greenplum Database 6.0 removes these features: The gpseginstall MADlib, GPText, and PostGIS are not yet provided for installation on Ubuntu systems. Greenplum for Kubernetes is not yet provided with this release. The following table lists key known issues in VMware Tanzu type parsing errors unexpected value type errors data type conversion errors errors returned by native and user-defined functions LOG ERRORS returns error information for data exceptions only. When it

6 Client and Loader Tools package for Windows does not support running the gpfdist program as a native Windows service. Removed Features Pivotal Greenplum Database 6.0 removes these features: The gpseginstall MADlib, GPText, and PostGIS are not yet provided for installation on Ubuntu systems. Greenplum for Kubernetes is not yet provided with this release. The following table lists key known issues in VMware Tanzu type parsing errors unexpected value type errors data type conversion errors errors returned by native and user-defined functions LOG ERRORS returns error information for data exceptions only. When it

6 Client and Loader Tools package for Windows does not support running the gpfdist program as a native Windows service. Removed Features Pivotal Greenplum Database 6.0 removes these features: The gpseginstall MADlib, GPText, and PostGIS are not yet provided for installation on Ubuntu systems. Greenplum for Kubernetes is not yet provided with this release. The following table lists key known issues in VMware Tanzu type parsing errors unexpected value type errors data type conversion errors errors returned by native and user-defined functions LOG ERRORS returns error information for data exceptions only. When it

MADlib, GPText, and PostGIS are not yet provided for installation on Ubuntu systems. Greenplum for Kubernetes is not yet provided with this release. The following table lists key known issues in VMware Tanzu availability and correctness in the event of a hardware failure. Kubernetes enables quick recovery from both pod and host failures, and Kubernetes storage services provide a high level of availability for the mirroring solutions. For these reasons, mirrorless deployments are fully supported with Greenplum for Kubernetes. Other deployment environments are generally not supported for production use unless both Greenplum

案例分享：上海航空 结算 系统 源系统 Oracle GreenPlum 结算 ETL Staging ETL 结算 ODS Export 文 本 Query (oracle native driver) BO前端 呼叫 中心 航线 分析 其他 ETL ETL ETL 原有数据仓 库部分（包 括EDW, DM, ODS。不含 结算ODS ) Query (ODBC) Greenplum-db-3.2.0.2-Solaris-x86-64 Greenplum-Client SoftWare(PSQL) Greenplum ODBC Driver Greenplum Native Interface - Datastage Solaris 10 OS Segment Host Segment Host Master Host Interconnect - Gigabit

size has been improved. The PgBouncer distributed with Greenplum Database 6.22.0 adds support for native LDAP authentication between the psql client and the pgbouncer process. Refer to Configuring LDAP-based 6 Client and Loader Tools package for Windows does not support running the gpfdist program as a native Windows service. Removed Features Pivotal Greenplum Database 6.0 removes these features: The gpseginstall type parsing errors unexpected value type errors data type conversion errors errors returned by native and user-defined functions LOG ERRORS returns error information for data exceptions only. When it

size has been improved. The PgBouncer distributed with Greenplum Database 6.22.0 adds support for native LDAP authentication between the psql client and the pgbouncer process. Refer to Configuring LDAP-based 6 Client and Loader Tools package for Windows does not support running the gpfdist program as a native Windows service. Removed Features Pivotal Greenplum Database 6.0 removes these features: The gpseginstall type parsing errors unexpected value type errors data type conversion errors errors returned by native and user-defined functions LOG ERRORS returns error information for data exceptions only. When it

size has been improved. The PgBouncer distributed with Greenplum Database 6.22.0 adds support for native LDAP authentication between the psql client and the pgbouncer process. Refer to Configuring LDAP-based 6 Client and Loader Tools package for Windows does not support running the gpfdist program as a native Windows service. Removed Features Pivotal Greenplum Database 6.0 removes these features: The gpseginstall type parsing errors unexpected value type errors data type conversion errors errors returned by native and user-defined functions LOG ERRORS returns error information for data exceptions only. When it