📄️ 2.1 Data Engineering & Data Integration
The basic concept regarding Data Engineering and Data Integration in is transforming incoming data, which is delivered via Data Pumps, from different sources into a common Model based on Target Entities and Relationships. These components represent the Staging Layer. Based on the Model and the data present in the Staging Layer the knowledge graph can be generated via the Processing step.
📄️ 2.2 Processing
As in chapter Data Engineering & Data Processing described the generation of the knowledge graph is called Processing. In this process, data is stored in the Staging Layer and transformed into nodes and edges, then saved in the graph database Neo4j.
📄️ 2.3 Dashboard
GBS Dashboard
📄️ 2.4 Data Pumps & Containers
Data Pump Images
📄️ 2.5 Target Entities
Target Entities
📄️ 2.6 Relationships
Create and edit Relationships
📄️ 2.7 Graph Building - Data Importer
The DataImporter is the interface where the user can define the mapping between the extracted source objects the the Target Entities.
📄️ 2.8 File Storage
The File Storage enables storage of files in the system. These files can be accessed via URL and can
📄️ 2.9 Load Plans
To populate the knowledge graph in the with data we have to perform two main tasks:
📄️ 2.10 Workers
GBS enables the management of Workers. The user can register Workers in this simple form by providing the required information.
📄️ 2.11 Graph Access Rules
The Graph Access Rules define rules for the Graph Security Layer. Through these definitions a certain user is
📄️ 2.12 Views
Views are a starting location which can be defined by the user. They can be accessed from the EBS and
📄️ 2.13 Workspaces
Workspaces assign Target Entities to users. Therefore the creator of a workspace has to assign users to a workspace and select the Target Entities that the users are allowed to see. Users that are not included into the workspace cannot see the Target Entities in the GBS. Workspaces are used to exclude unpermitted users from accessing Target Entities and can also be used to structure Target Entities in groups and only show them when a workspace is selected.
📄️ 2.14 System
Configuration
📄️ 2.15 API Push Service
The API Push Service is a generic method for importing data into the Graph Builder Service (GBS) system, in addition to the Data Pumps.
📄️ 2.16 Functions
Functions are analogous to Views, with key distinctions in query execution capabilities and how the