Batch Data Processing

Versie 1.0
Creatie datum 02-05-2021

Streaming Access Storage*

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Streaming Access Storage*

Automated Data Replication and Reconstruction

How can large amounts of data be stored in a fault tolerant manner such that the data remains available in the face of hardware failures?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Automated Data Replication and Reconstruction

Automated Dataset Execution

How can the execution of a number of data processing activities starting from data ingress to egress be automated?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Automated Dataset Execution

Relational Source

How can large amounts of data be imported into a Big Data platform from a relational database?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Relational Source

Data Size Reduction

How can the size of the data be reduced to enable more cost effective storage and increased data movement mobility when faced with very large amounts of data?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data Size Reduction

Automated Data Sharding

How can very large amounts of data be stored without degrading the access performance of the underlying storage technology?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Automated Data Sharding

Large Scale Batch Processing

How can very large amounts of data be processed with maximum throughput?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Large Scale Batch Processing

Batch Big Data Processing*

The Batch Data Processing compound pattern represents a solution environment capable of ingesting large amounts of structured data for the sole purpose of offloading existing enterprise systems from having to process this data.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Batch Big Data Processing*

Complex Logic Decomposition

How can complex processing tasks be carried out in a manageable fashion when using contemporary processing techniques?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Complex Logic Decomposition

Dataset Denormalisation

How can a dataset, where related attributes are spread across more than one record, be stored in a way that lends itself to distributed data processing techniques that process data on a record-by-record basis?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Dataset Denormalisation

High Volume Tabular Storage

How can large amounts of non-relational data be stored in a table-like form where each record may consist of a very large number of fields or related groups of fields?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van High Volume Tabular Storage

Relational Sink

How can large amounts of processed data be ported from a Big Data platform directly to a relational database?

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Relational Sink