天天看點

ETL for Oracle to PostgreSQL 3 - DATAX

标簽

PostgreSQL , Oracle , ETL , datax

https://github.com/digoal/blog/blob/master/201805/20180505_03.md#%E8%83%8C%E6%99%AF 背景

Datax是阿裡巴巴開源的一款ETL工具,在雲端可以作為服務直接使用,同時使用者也可以下載下傳開源代碼自行部署。

https://github.com/digoal/blog/blob/master/201805/20180505_03.md#1-%E5%BC%80%E6%BA%90datax 1 開源Datax

http://gitlab.alibaba-inc.com/datax/datax/wikis/quick_start

https://github.com/digoal/blog/blob/master/201805/20180505_03.md#%E9%85%8D%E7%BD%AE%E6%BA%90%E7%AB%AF%E6%95%B0%E6%8D%AE%E6%BA%90-oracle-reader 配置源端資料源 Oracle reader

http://gitlab.alibaba-inc.com/datax/datax-wiki/wikis/datax-plugin-oraclereader

https://github.com/digoal/blog/blob/master/201805/20180505_03.md#%E9%85%8D%E7%BD%AE%E7%9B%AE%E6%A0%87%E6%95%B0%E6%8D%AE%E6%BA%90-postgresql-writer 配置目标資料源 PostgreSQL writer

http://gitlab.alibaba-inc.com/datax/datax-wiki/wikis/datax-plugin-pgwriter

https://github.com/digoal/blog/blob/master/201805/20180505_03.md#2-%E9%98%BF%E9%87%8C%E4%BA%91%E6%9C%8D%E5%8A%A1dataworks 2 阿裡雲服務DataWorks

https://github.com/digoal/blog/blob/master/201805/20180505_03.md#%E9%85%8D%E7%BD%AE%E6%BA%90%E7%AB%AF%E6%95%B0%E6%8D%AE%E6%BA%90-oracle-reader-1

https://help.aliyun.com/document_detail/47765.html

https://github.com/digoal/blog/blob/master/201805/20180505_03.md#%E9%85%8D%E7%BD%AE%E7%9B%AE%E6%A0%87%E6%95%B0%E6%8D%AE%E6%BA%90-postgresql-writer-1

https://help.aliyun.com/document_detail/47767.html

PostgreSQL Writer

https://help.aliyun.com/knowledge_detail/49830.html

https://github.com/digoal/blog/blob/master/201805/20180505_03.md#%E9%99%84%E5%8A%A0%E8%AF%B4%E6%98%8E 附加說明

Datax在阿裡雲端使用時,支援BULK模式(使用rds pg, hdb pg, rds ppas的oss外部表),從OSS并行加載到PostgreSQL, PPAS, HDB PG中。