首页>大数据> 正文

开源大数据ETL工具

来源:商群邮件营销时间:2017-02-25 17:54:41点击:1699

BigData ETL Tools

datatorrent(apex)

执行 ./datatorrent-rts-community-3.7.0.bin --help 打印帮助项

[qihuang.zheng@dp0653 install]$ sudo -u admin ./datatorrent-rts-community-3.7.0.bin \
-B /usr/install/datatorrent-rts -g 9094 \
-E DT_LOG_DIR=/home/admin/datatorrent \
-E DT_RUN_DIR=/home/admin/run/datatorrent

Verifying archive integrity... All good.
Uncompressing DataTorrent Distribution  100%

DataTorrent Platform 3.7.0 will be installed under /usr/install/datatorrent-rts/releases/3.7.0

dtGateway can be managed with: /usr/install/datatorrent-rts/releases/3.7.0/bin/dtgateway [start|stop|status]
DTGateway is running as pid 24571 and listening on 0.0.0.0:9094

Please finish the remaining installation steps via DataTorrent Console at: http://dp0653:9094/

创建apex项目,并打包

name=salesapp
version=3.5.0

mvn -B archetype:generate \
  -DarchetypeGroupId=org.apache.apex \
  -DarchetypeArtifactId=apex-app-archetype \
  -DarchetypeVersion=$version  \
  -DgroupId=com.example \
  -Dpackage=com.example.$name \
  -DartifactId=$name \
  -Dversion=1.0-SNAPSHOT

上传到datatorrent平台

StreamSets( https://github.com/streamsets/datacollector )

StreamFlow( https://github.com/lmco/streamflow )

CDAP( https://github.com/caskdata/cdap )

欢迎大家继续关注商群邮件营销平台,也可以在我们的商群官网了解更多邮件营销技巧,大数据知识,也可以通过电话:400-666-5494联系到我们,更多精彩知识、活动等着你。

相关阅读

Copyright 2015-2016 商群EDM邮件营销 版权所有 闽ICP备16004793号-1
在线咨询×
2421927587
联系电话

18906040695