天天看點

大資料情報第三期(2018-07-02)

《OpenAI Dota2 5v5模式擊敗人類,AI每天訓練量抵人類180年》

今天淩晨,OpenAI通過官方部落格宣布了其在Dota對抗上的新進展——由五個神經網絡組成的團戰AI團隊,在5v5中擊敗了業餘人類玩家,并表示,将有望挑戰頂級專業團隊。

《事非經過不知難,京東Kubernetes的定制與優化》

京東 618 當天,聊聊架構釋出了題為《

京東建構了全球最大的 Kubernetes 叢集,沒有之一

》的文章,系統回顧了京東基于 Kubernetes 的 JDOS 平台的演進曆程。今天這篇文章是整個系列文章的第一篇,将會從技術角度詳細剖析相關的實作,也希望能夠幫助後來者學習和參考。贈人玫瑰,手有餘香。

《Apache Beam 2.5.0》

We are glad to present the new 2.5.0 release of Beam. This release includes multiple fixes and new functionalities. For more information please check the detailed release notes.

《Getting Started with dA Platform on Google Kubernetes Engine》

dA Platform is a production-ready platform for stream processing with 

Apache Flink®

. The Platform includes open source Apache Flink, a stateful stream processing and event-driven application framework, and dA 

Application Manager

, the central deployment and management component of the product.

《Static website hosting for Azure Storage now in public preview》

Today we are excited to announce the public preview of __static website hosting for Azure Storage__! The feature set is available in __all public cloud regions __with support in government and sovereign clouds coming soon__.__

《The emerging big data architectural pattern》

Lambda architecture is a popular pattern in building Big Data pipelines. It is designed to handle massive quantities of data by taking advantage of both a 

batch

 layer (also called cold layer) and a 

stream-processing

 layer (also called hot or speed layer).

《Using the Retry pattern to make your cloud application more resilient》

Running your application in containers or in the cloud does not automatically make your application resilient. It’s up to you to configure the features that will enable the retry logic you provide. When you need retry logic added to your system, you should use a library such as Polly to speed up your implementation. Or, if you are exploring how to add resiliency without code, you should investigate service mesh products like 

Istio

 and 

Linkerd

.

《A closer look at Azure Data Lake Storage Gen2》

On June 27, 2018 we 

announced

 the preview of Azure Data Lake Storage Gen2 the only data lake designed specifically for enterprises to run large scale analytics workloads in the cloud. Azure Data Lake Storage Gen2 takes core capabilities from Azure Data Lake Storage Gen1 such as a Hadoop compatible file system, Azure Active Directory and POSIX based ACLs and integrates them into Azure Blob Storage. This combination enables best in class analytics performance along with Blob Storage’s tiering and data lifecycle management capabilities and the fundamental availability, security and durability capabilities of Azure Storage.

《Azure Elastic Database jobs is now in public preview》

We are excited to announce the availability of a new, significantly upgraded public preview release of 

Azure Elastic Database jobs

. Elastic Database jobs is now a fully Azure-hosted service. Unlike the earlier, customer-hosted and managed version of Elastic Database jobs, this version is an integral part of Azure with no additional services or components to install and configure. This release also adds significant capabilities making it easy for customers to automate and execute T-SQL jobs using PowerShell, REST, or T-SQL APIs against a group of databases. These jobs can be used to handle a wide variety of tasks such as index rebuilding, schema updates, collection of query results for analytics, and performance monitoring.

《Amazon MQ Introduces Four New Broker Instances》

Amazon MQ now supports four new M5 broker instances that enable you to scale your brokers to meet higher throughput requirements.  

《Apache Pulsar 2.0支援模式系統資料庫和主題壓縮》

最新版本的開源分布式消息傳遞架構

Apache Pulsar

讓企業能夠實時處理資料,進而“超越了批次處理”。

Streamlio

最近宣布推出Apache Pulsar 2.0.1流式消息解決方案。最新版本支援Pulsar Function、模式系統資料庫和主題壓縮。

《Data vs. Goliath: How retailers come out on top in the age of transformation》

On June 6, 

Treasure Data

 hosted 

marketing

 leaders from across the Bay Area to discuss how companies can compete against the “Goliaths” in the marketplace through innovative and responsible use of customer data. We were lucky to be joined by partners 

Cloudwick Chartio

, who provided additional color on the topic. For those who couldn’t join us, our CMO provides an overview of key retail trends and successful strategies below. Check out the 

accompanying webinar

 for even more insight!