The original article "Big Data Governance, Big Data Architecture, Big Data Intelligent Platform, Big Data Decision Platform Scheme" PPT format, a total of 66 pages. Main construction content: big data overall architecture, big data collection and exchange platform, big data processing platform, big data asset management platform, big data exchange platform, big data interface operation and maintenance platform, big data analysis and mining platform, big data intelligence platform, big data decision-making platform.
Big data overall architecture
•Data lakes are the best place to store data that has been governed and consolidated
•The data lake architecture decouples data governance and big data application development, and can support the blooming of applications
• Data lakes ensure that data is the user's data, not the app developer's data
•Multiple application development with different characteristics can obtain the data needed from the data lake, which greatly accelerates the speed of application development
Big data overall architecture
Big data collection integration platform
Database real-time exchange
Database real-time exchange
Database real-time exchange and sharing platform
Database real-time exchange and sharing platform
Database data replication and real-time technology
Database data replication and real-time technology
Big data processing platform
Big data processing platform positioning
It provides enterprise users with a complete set of data lake governance solutions related to data collection, storage, computing, scheduling, exploration, monitoring, security, etc., and provides data analysts with the efficiency of data preparation
Big data processing platform positioning
Big data processing platform: target effect
Big data processing platform: target effect
Big data processing platform - data collection
Big data processing platform - data collection
Big data asset management platform
Data asset management system
Data asset management system
Data asset control – asset view
Data asset control – asset view
Big data exchange platform
Data sharing platform – goal
Data sharing platform – goal
Big data interface operation and maintenance platform
Interface O&M platform
1) According to the topology, the real-time throughput of components, platforms, and physical devices can be calculated accordingly;
2) Including the response time of the overall call and the response time of each service, etc.;
3) Error records, according to the service return statistics unit time abnormal times;
4) Alarm function, provide various threshold warning functions.
Interface O&M platform
1) AGENT's non-intrusive deployment has no impact on the original service, and the resource consumption is extremely low;
2) Accurately grasp the deployment of production front-line applications;
3) Provide traceable performance data to quantify the service status of IT systems;
4) From the perspective of the whole process performance of the call chain, identify the key call chain and assist the continuous optimization of system personnel.
Interface O&M platform
Big data analysis mining platform
•Enterprise-level and public-level big data intelligent analysis platform
•An enterprise-level data warehouse product that provides sub-second SQL analysis capabilities on ultra-large data sets and supports Internet-level high concurrent access, which is a solution based on the industry-standard data warehouse and business intelligence methodology architecture DW (Data Warehouse) on Hadoop
•Provide simple and fast big data analysis services for business users, analysts and engineers;
Self-service agile BI: high-performance query modeling, self-service modeling, no programming, JDBC/ODBC support, non-intrusive deployment, and other outstanding advantages
• Innovations in areas such as data lakes
Big data analysis mining platform
Big data intelligence platform
Big data intelligence platform
Big data decision-making platform
Decision Management System. function