天天看點

大資料技術的對決——Spark對Impala對Hive對Presto

大資料技術的對決——Spark對Impala對Hive對Presto

在大資料浪潮全面來襲的曆史背景下,我們一直面臨着同一類難題的困擾——該選擇哪款工具解決相關問題?這項挑戰在大資料sql引擎領域同樣存在。作為大資料報告工具開發商,atscale公司通過基準測試為我們帶來了如下答案:

1. spark 2.0在大規模查詢性能方面可達1.6版本的2.4倍。二者的小規模查詢性能基本持平。

spark 2.0 improved its large query performance by an average of 2.4x over spark 1.6 (so upgrade!). small query performance was already good and remained roughly the same.

2. impala 2.6版本在大規模查詢性能可達2.3版本的2.8倍,小規模查詢基本持平。

impala 2.6 is 2.8x as fast for large queries as version 2.3. small query performance was already good and remained roughly the same.

3. hive 2.1配合llap在大規模查詢場景下可實作1.2版本性能的3.4倍,小規模查詢性能則為2倍。

hive 2.1 with llap is over 3.4x faster than 1.2, and its small query performance doubled. if you're using hive, this isn't an upgrade you can afford to skip.

本文作者:佚名

來源:51cto