Earlier, we talked about Alibaba's "three-step" project plan for building a data middle platform:
- Phase 1: Complete the global architecture.
- Phase 2: Grasp the data construction of key business.
- The third stage: fully roll out and gradually promote the construction of the data common layer of each lunar landing project.
After the completion of the first and second phases of Alibaba's data public layer construction, it has not only achieved results in reducing costs and improving efficiency, but also cultivated data professionals and strengthened the connection and trust within the data team and with the business team.
Therefore, in the process of the full rollout of the third phase, there are few obstacles, on the contrary, there is a lot of support.
The third stage has been completed: the operation of the data common layer, the opening of metadata, the construction of the middle layer of Tmall data, the data asset management platform, the data modeling tool based on metadata, and the instrumentalization of the whole process of the onedata system.
The Straw Hat Kid thinks: The whole three-step project plan is similar to the revolution when it comes to fighting. At the beginning, when there was a shortage of manpower, an overall battle plan was drawn up first, and then key cities were attacked, and after a certain amount of influence, troops were recruited and rolled out and pushed forward in an all-round way.
After all, the construction of the middle platform is related to multiple business parties, and even affects the interests of business parties. The business side will think, the data is placed in me, we put forward our own needs, and develop it ourselves, how convenient it is, why do we need outsiders to intervene.
At this time, the data team needs to conquer the business side with professionalism and make the business side feel the sweetness, so that the next thing will be logical.
We talked a lot about the construction process and methods before, so are there any intuitive cases in the whole plan?
Public Floor Construction Case:
1. Tao system data basic layer governance project
In view of the problems existing in TBODS (Taobao Data Basic Layer) at that time, special governance was carried out, TBODS was simplified, specifications were formulated, and measures were taken to continuously maintain and reduce the consumption of storage resources and computing resources in the ODS data basic layer.
2. Log data public layer construction project
Based on the success of Alibaba's data public layer initialization construction, the log traffic model was further improved, including the wireless traffic transaction engine model, and the traffic analysis product was reconstructed and supported by new requirements.
Straw hat boy thinks: most companies will first focus on business data that is more closely related to the business, while log data and buried data are often ignored, lack of special maintenance, and different data calibers.
3. Realize the unified reconstruction of Alibaba's data common layer
Migrate data from the cloud computing environment 1 that SMFS relies on to the cloud environment 2 that the public data layer depends on.
4. Juhuasuan data middle layer construction project
Based on Alibaba's data public layer, the data middle layer of the Juhuasuan Division is planned to serve the Juhuasuan business in a more standard and faster way.
5. Search for data middle tier construction projects
Construct the middle layer migration report of the main search and the main client search data of the Tao system.
6. 1688 data common layer and data application layer construction project
Based on the moon landing construction of the 1688 data public layer and data application layer, the internal and external applications of the 1688 service are realized.
7. Alibaba operates key data construction projects
Based on Alibaba's data public layer, it unifies the caliber of internal and external data, and provides indicators that COOs focus on.
8. Core operational data and industry data construction projects
Based on Alibaba's data public layer, migrate the core operation reports on the cloud computing environment1, integrate industry data, and complete and improve the industry 360 products serving Alibaba.
9. Special project for the construction of wireless data public layer
In the second phase of the second phase of Alibaba's data public layer construction, a scenario-based special project was launched in response to the needs of business departments, aiming to build a unified wireless data public layer to comply with the tide of "ALL IN wireless".
Straw hat boy thinks: The data between more than a dozen wireless applications is not connected, it is very uncomfortable to use, each with its own use, and when adding a new dimension limited to the mobile indicator, you need to pull the table from each detail layer to find the number.
10. Special project for the construction of real-time data public layer
In the second phase of the second phase of Alibaba's data public layer construction, a technology exploration project was launched in response to the needs of technology departments and business departments, aiming to build a unified real-time data public layer, improve technology and improve the business experience of technology departments.
Straw hat boy thinks: At present, some real-time data is used scattered, mainly relying on finding tables and pulling tables everywhere, if you can do a good job in the construction of real-time data data warehouse, you can also avoid the trouble of finding numbers to a large extent.
Columnist
Straw hat boy, public account: a data person's own place, everyone is a product manager columnist. Author of the book "The Road to Big Data Practice: Data Middle Platform + Data Analysis + Product Application", focusing on the field of user portraits.
This article was originally published on Everyone is a Product Manager. Reproduction without permission is prohibited
The title image is from Unsplash and is licensed under CC0.
The views in this article only represent the author's own, everyone is a product manager, and the platform only provides information storage space services.