storm模式
log -> flume -> kafka -> storm -> spout -> bolt(redis) -> bolt(mysql) -> bolt(hbase)
spark streaming模式
log -> flume -> kafka -> spark streaming-> map -> reduce -> redis(mysql)
数据源
clicks(点击流),sensor(传感器),log(日志)
ELK模式
log -> ELK框架
storm模式
log -> flume -> kafka -> storm -> spout -> bolt(redis) -> bolt(mysql) -> bolt(hbase)
spark streaming模式
log -> flume -> kafka -> spark streaming-> map -> reduce -> redis(mysql)
数据源
clicks(点击流),sensor(传感器),log(日志)
ELK模式
log -> ELK框架