Big Data Platform
Big Data Platform
BIG DATA PLATFORM
In the era of the digital wave sweeping almost all industries, the data middle platform has become one of the most important starting points for digital transformation. Grand Digital Group has assisted many retail enterprises in completing the construction of big data platforms:
Big Data Platform Capabilities
The big data platform, independently developed by Grand Digital Group, includes various products and services, such as big data basic services, data analysis and presentation, data application development, and artificial intelligence. Through tempering and business verification, it can help enterprises quickly establish their own big data application capabilities.
01 Data cloud portal
02 Real-time computing platform
03 Data platform development
04 Big data basic service platform
05 Data Integration
06 Metadata management platform
07 Data Detection
08 Machine learning platform
09 Accurate computing platform
10 Kafka serving
Data Detection Platform
The data detection platform, independently developed by Grand Digital Group, is mainly used to provide online data development and business data analysts for online data exploration and business data analysis, mainly solving the following four types of problems:
1) After the bastion machine permissions are tightened, provide users with access to the hive table data.
2) Combined with the relay data management system to ensure the security of data access.
3) Provide users with the ability to conduct raw data analysis.
4) Resources are isolated to ensure platform stability.
Data Integration Capability
The data integration capability of Grand Digital Group provides a stable, efficient, flexible and scalable data synchronisation platform, supports clustering, servitisation, multi-tenant and standard expansion, and provides data transmission and interaction services in all aspects, so that data will no longer become an island. Compared with other similar products, data integration has many advantages:
1
Diversification
1. Diversified data channel support
2. Complete data transmission methods
3. Rich data processing plug-ins
2
Fast
1. Efficient invocation
2. Strong transmission rate
3. Strong handling ability
3
Excellence
1. Robust transmission channels
2. Intelligent error detection
3. Automatic transmission recovery
4
Convenience
1. No need to build, ready-to-use
2. Dynamic allocation and elastic expansion
3. Pay as you need, and pay as quantity is used
Batch Data Synchronisation
Data integration supports the transmission capacity of all major data storage products on the cloud, supports users to purchase data transmission channels on demand, and supports users to complete links. Flow control protection, support transmission custom processing conversion, data integration support transmission service dirty data collection and display.
Timed Task Scheduling
Data integration Supports offline task scheduling with multiple time dimensions (day, hour, and minutes) and completes incremental data extraction in several steps.
Task Error Alarm
When a task fails, data integration notifies users of task failure in a predefined manner. You can customise alarm rules to configure alarm rules.
The Real-time Computing Platform
A real-time streaming computing service platform based on the Storm platform with convenient task management, rapid deployment and online, comprehensive monitoring and multi-tenant application isolation capabilities. Storm processes one incoming event at a time, so the real-time computing platform built on Storm can be used in time-demanding (microsecond level) business scenarios, such as real-time monitoring services.
| Introduction to Quasi-real-time computing platform | Provide simple and efficient task management functions, including task record management and multi-version management of task running package; Provide platform-level and task-level alarm configurations, and support tasks to flexibly select configurations according to different service requirements; Provide operation monitoring management based on task dimension, monitoring items including unexpected task termination, processing timeout, scheduling timeout, etc.; Provide feather-scale chart display function, including task-based performance view and platform-based CPU resource view; |
| Introduction to the machine learning platform | Machine Learning Platform (MLAAS) is an intelligent machine learning platform integrating data business mining, data analysis and data business modelling The machine learning platform (MLAAS) relies on the powerful computing power of the underlying platform and applies advanced big data technology. By providing visual, process-based, and configurable efficient data mining tools, complete data pre-processing means and the comprehensive algorithm model application platform, the machine learning platform (MLAAS) accelerates the speed of enterprise big data mining and reduces the cost of big data mining, which means the rapid realisation of enterprise data value! While focusing on the ability of big data mining, MLAAS platform has been making great efforts on user experience, striving to lower the threshold for the use of the platform and reduce the learning and use costs of users. The platform experiment adopts visual technology, and the complex data acquisition process can be completed by simple "dragging, pulling, matching" and other ways on the page. Mask professional technology, and data at your fingertips! |
| Introduction to relay data management platform | Hive warehouse relay data information display platform to maximise the value of data resources; Provide the access authorisation approval process for Hive tables, realise automated permission approval, improve work efficiency, and enhance data security audit capabilities; Add governance rules for data tables, effectively identify temporary tables, garbage tables, and tables left over from history, and improve data warehouse governance capabilities; In addition to providing Hive relay data, it also provides the retrieval capability of kafka instant relay data. |
