Big Data Mechanisms in Big Data Blueprint

Plot of the described mechanisms on the Big Data Blueprint

Versie 1.0
Creatie datum 02-05-2021

Data processing

Processing activities for filtering, cleaning and transformation of datasets

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data processing

Data utilisation

Usage of the processed data in work processes in the consumer organisation

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data utilisation

Data analysis

Analysing the cleaned, aggregated and filtered datasets

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data analysis

Data acquisition

Selecting data sources on information content and data qualities

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data acquisition

Data governance

Data governance activities and application functions layers for maintaining qualities of the datasets

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data governance

Data management

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data management

Data security

Application functions and activities for securing datasets and storage functionalities

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data security

Data storage

Storage of primary and temporary datasets for usage in higher layers of the architecture

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data storage

Data sources

Not part of a data architecture but the input of the architecture, it is the raw material of a data pipe and therefore an essential part

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data sources

Data visualisation

Visualisation of the data or information for interpretation by analists and users

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data visualisation

Resource Manager

Management function for the various resources in a Big Data environment

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Resource Manager

Analytics Engine

Functionality for analysing the transformed and standardized data in a data analytics tool.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Analytics Engine

Storage Device

Storage function of big data sets.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Storage Device

Data Transfer Engine

Transformation and transfer functionality from data sources to storage, processing and usage.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data Transfer Engine

Processing Engine

Processing of data for transformation, cleaning and filtering of data

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Processing Engine

Coordination Engine

Coordination of automated tasks for example in batch processes and mapreduce.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Coordination Engine

Visualization Engine

Visualisation of query and analytics results to data scientists and end users.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Visualization Engine

Compression Engine

Big data sets can be voluminous so compressing has advantages for storage and/or processing

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Compression Engine

Productivity Portal

Portal functionality to give users and administrator access to the other logical functionalities in a Big Data environment.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Productivity Portal

Query Engine

Retrieval and querying function on the transformed and standardized datasets

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Query Engine

Serialization Engine

Serialization and deserialization of proprietary datasets to standardized stored datasets

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Serialization Engine

Workflow Engine

Functionality to design workflows to automatically perform transformations and cleaning of datasets.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Workflow Engine

Data Governance Manager

Register function for the governance of data sets in relation to consumers, business owners and qualities.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data Governance Manager

Cluster Manager

Management of clusters in a distributed or cloud based infrastructure

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Cluster Manager

Security Manager

Administration and registration of security concepts in a Big Data environment.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Security Manager