Plasma Configuration Tables
- 1 Plasma Common Company Parameters (CP) Tables
- 2 Plasma Transactions CP Tables
- 3 Plasma Quotes CP Tables
- 4 Plasma Harvester CP Tables
- 4.1 Plasma_Quotes_Harvester_Mapping / Plasma_Transactions_Harvester_Mapping
- 4.2 Plasma_Quotes_Harvester_Validator / Plasma_Transactions_Harvester_Validator
- 4.3 Plasma_Quotes_Harvester_Audit / Plasma_Transactions_Harvester_Audit / Plasma_KPI_Audit
- 4.4 Plasma_Harvester_SequenceControlTable / Plasma_KPI_Distributor_SequenceControlTable
- 4.5 Plasma_KPI_Refresher
- 4.6 Margin_Tracker_Config
- 4.7 Margin_Tracker_Audit
Plasma Common Company Parameters (CP) Tables
Plasma_Config
Contains general mapping of each Extractor, such as the primary source type and name, etc.
Field name | Description |
---|---|
Config Name | Name of different configuration properties. Values: DataPartitionedForLoad, PrimarySourceAlias, PrimarySourceName, PrimarySourceType, etc. (available as dropdown) |
Config Owner | Owner (Extractor name) of the respective configuration properties. |
Config Value | Value of the respective configuration properties. Example: primary source name of an extractor. |
Is Active? | Flag to identify if the current row configuration is active (included in the calculation) or not. |
Description | Description of the configuration property, if any. |
Plasma_Country_Region_Mapping
Contains country mappings.
Field name | Description |
---|---|
Country | Country name in full form. |
Region | Pre-defined set of regions for Plasma. |
Alpha-2 Code | Country Code in 2-character format. |
Alpha-3 Code | Country Code in 3-character format. |
Plasma_OperatorMapping
Contains the mapping of a string value to the respective operator.
Field name | Description |
---|---|
Name | String value of an operator, such as EQUAL, NOT_EQUAL, IN, NOT_IN, BETWEEN, NOT_NULL, NULL, LESS_THAN, GREATER_THAN, etc. |
Value | Respective operator value, such as =, !=, IN, NOT IN, BETWEEN, IS NOT NULL, IS NULL, <, >, etc. |
Plasma_Audit
Contains the auditing information of each Extractor.
Field name | Description |
---|---|
Extractor | Name of the extractor. |
Audit Date | DateTime when the message is logged. |
Status | Either SUCCESS or ERROR. |
Message | Message regarding the number of fetched, processed rows, etc. |
Additional Info | Additional info in case of an error or omitted rows. |
Omitted Rows | Number of omitted rows. |
Plasma_KPI_SequenceControlTable
Defines jobs for managing/starting KPI Refresh steps.
Field name | Description |
---|---|
Sequence Name | Unique name of the sequence (usually the extractor name). |
Order | The order in which the particular jobs in a sequence are executed. |
Type | Sequence type (DL, CFS, etc.). |
Action Name | Name of the job (Label of DL, CFS, etc.). |
Status | Status of the sequence (DONE, PROCESSING, ERROR). If empty, this job will be executed next in the order. |
Last Run | Last processed run date time. |
DL Type | Type of the DL (Calculation, Refresh, etc.). |
Dl Target | Target Name of the DL. |
Is active | Flag to identify if the current row configuration is active (included in the sequence) or not. |
Plasma Transactions CP Tables
Plasma_Transactions_Extractor_Fields
Contains the target fields and whether any of them are mandatory for the Extractor. Can also define a default value to use in case of null.
Field name | Description |
---|---|
Extractor Name | Unique name of the Extractor, to handle multiple mapping information. Keep this as “Transactions”. |
Field Name | Name of the target field. |
Is Required? | Flag to identify if the target field is mandatory for the Extractor. |
DataType | Data type of the field. For future use. |
Default Value | Default value of the field, if any. |
Error Message | Error message, if any. |
Plasma_Transactions_Extractor_Mapping
Contains the mapping of source fields to the target fields of each Extractor, along with formulas, filters, join conditions, etc.
The Target Field values are sourced from the Plasma_Transaction_Fields CP (can be selected in a dropdown by users).
Field name | Description | Instructions |
---|---|---|
Extractor Name | Unique name of the extractor, to handle multiple mapping information. | Keep this as “Transactions”. |
Source Type | Type of the source. Supported types are DS, DM, P, C, PX, CX, PP. | Specify the type of the source (PP stands for CP - Company Parameters) |
Source Name | Name of the source. Self-join can be achieved by specifying a different Table Alias. | Specify the name of the source. |
Table Alias | Alias of the temporary table. | Specify an alias for the source to easily refer to it in the formula. |
Target Field | Name of the Target Field in Plasma. | Specify the target field in Plasma_TX Data Source. The list of allowed values is in the Plasma_Transactions_Extractor_Fields table. The fields with ‘Required' flag set to Y are needed for the Extractor to work, otherwise it throws an error. You can also use temporary fields Temp1…Temp30 to hold values that are not in the target. They can be accessed via a drop-down. |
Source Fields | Name(s) of the source fields that are mapped to the target field. Can be multiple fields, separated by a comma without spaces. | Specify the source fields which are mapped from the source. There can be one or many, separated by a comma. It can be empty if the source fields are not needed and the value can be derived directly from the formula. |
Formula | Additional formulas to apply to the source fields, such as CONCAT, TO_DATE, DEFAULT, EXPR, DECODE and GROUPBY functions (SUM, AVG, COUNT, MAX, MIN, etc.). All source fields can be referred to by the format "(<tableAlias>.<sourceField>)". All target fields can be referred to by the format "(TGT.<targetField>)". GroupBy formulas – Only when the Group By field is populated and only one source field should be mapped. Available values are SUM, AVG, COUNT, MAX, MIN. Function formulas – Only when the Group By field is not populated:
| Specify a formula/expression if any calculation needs to be done on the source fields and/or target fields. All fields should be prefixed with tableAlias, delimited with a dot (.) and wrapped in braces ( ). Below are the available formulas. |
Group By | Name(s) of the GROUPBY fields when the formula applied is of the GROUPBY function. Can be multiple names separated by a comma without spaces. Available values are SUM, AVG, COUNT, MAX, MIN. | Specify the groupBy field when the groupBy formula is used. Can be one or many, separated by a comma. |
Joining Key | Name of the Joining Source's field. (Always LEFT join is applied on Source to Joining Source.) It is in the format "<tableAlias>.<sourceField>". | When there are multiple sources, specify which key joins the two sources, referred to by the format <tableAlias>.<sourceField>. Also the operator should be provided. The sources are all joined using LEFT_JOIN, so it is important to identify primary source, so that all data from primary source will be extracted even if the other sources do not have joining key data. |
IsActive? | Flag to identify if the current row mapping is active (included in the calculation) or not. | Should be “Y”. Else the mapping row will not be visible to the Extractor. |
Operator | Operator to be used for either JoiningKey or Filter. Supported types are EQUAL, NOT_EQUAL, IN, NOT_IN, BETWEEN, NOT_NULL, NULL, LESS_THAN, GREATER_THAN, etc. | The operator should be provided in two cases (but not both cases at once):
|
Filter | Additional filter that can be applied on the source data. | Specify a value if any filtering needs to be done on the source field values. Works with operators. |
Seed for Masking | Seed value to mask the target field's value in the target. Only applicable when target field is of the String type. | Specify a seed if the target field’s value needs to be masked in the target DS. Only applicable when the target field is of the String type. The seed can be any string. |
SellingFrom and SellingTo fields should use the region values from the Plasma_Country_Region_Mapping PP table. This table can be joined with the country of the company (SellingFrom) and country of the customer (SellingTo) using either Alpha-2 Code or Alpha-3 Code or country name in the PP table.
This Extractor works by creating a temporary table for each source and finally joining all the temporary tables by the joining keys, to select the source fields as target fields. Below is the example of the Plasma_TransactionMapping table.
Plasma_Transactions_SequenceControlTable
Defines the jobs and their order in one or more sequences.
Field name | Description |
---|---|
Sequence Name | Unique name of the sequence (usually the extractor name). |
Order | The order in which the particular jobs in a sequence are executed. |
Type | Sequence type (DL, CFS, etc.). |
Action Name | Name of the job (Label of DL, CFS, etc.). |
Status | Status of the sequence (DONE, PROCESSING, ERROR). If empty, this job will be executed next in the order. |
Last Run | Last processed run date time. |
DL Type | Type of the DL (Calculation, Refresh, etc.). |
Dl Target | Target Name of the DL. |
Is active | Flag to identify if the current row configuration is active (included in the sequence) or not. |
Plasma Quotes CP Tables
Plasma_Quotes_Extractor_Mapping
There is no strict structure (depending on the Datamarts used).
Column | Value | Description |
---|---|---|
Quote Type | {quote type} | Specifies the quote type. |
Mapping Field | {name of the column in the target of Quote Extractor (Plasma_Quotes DS)} | Target field – specifies the column in the target for which the extraction has to be done. |
Expression | {key for data extraction} | Specifies the key to get the data. Can be specified using dots and brackets expression. |
Configuration Type | calculation |
|
Extract Level | Q | Q – quote data |
Default Value | {default value of given field} | Specifies the default value if the result is not found (optional). |
Plasma_Quotes_Enrichment_Fields
The possible Target Fields for Quotes Enrichment.
Field name | Description |
---|---|
Extractor Name | Unique name of the Extractor, to handle multiple mapping information. Keep this as “Quotes”. |
Field Name | Name of the target field. |
Is Required? | Flag to identify if the target field is mandatory for the Extractor. |
DataType | Data type of the field. For future use. |
Default Value | Default value of the field (optional). |
Error Message | Error message (optional). |
Plasma_Quotes_Enrichment_Mapping
Fields used for Plasma Quotes Enrichment; the possible Target Fields are taken from Plasma_Quotes_Enrichment_Fields.
Field name | Description | Instructions |
---|---|---|
Extractor Name | Unique name of the extractor, to handle multiple mapping information. | Keep this as “Quotes”. |
Source Type | Type of the source. Supported types are DS, DM, P, C, PX, CX, PP. | Specify the type of the source. (PP stands for CP - Company Parameters) |
Source Name | Name of the source. Self-join can be achieved by specifying a different Table Alias. | Specify the name of the source. |
Table Alias | Alias of the temporary table. | Specify an alias for the source to easily refer to it in the formula. |
Target Field | Name of the Target Field in Plasma. | Specify the target field in Plasma_Quotes Data Source. The list of allowed values is in the Plasma_Quotes_Enrichment_Fields table. The fields with ‘Required' flag set to Y are needed for the Extractor to work, otherwise it throws an error. You can also use temporary fields Temp1…Temp30 to hold values that are not in the target. They can be accessed via a drop-down. |
Source Fields | Name(s) of the source fields that are mapped to the target field. Can be multiple fields, separated by a comma without spaces. | Specify the source fields which are mapped from the source. There can be one or many, separated by a comma. It can be empty if the source fields are not needed and the value can be derived directly from the formula. |
Formula | Additional formulas to apply on the source fields, such as CONCAT, TO_DATE, DEFAULT, EXPR, DECODE and GROUPBY functions (SUM, AVG, COUNT, MAX, MIN, etc.). All source fields can be referred to by the format "(<tableAlias>.<sourceField>)". All target fields can be referred to by the format "(TGT.<targetField>)". GroupBy formulas – Only when the Group By field is populated and only one source field should be mapped. Available values are SUM, AVG, COUNT, MAX, MIN. Function formulas – Only when the Group By field is not populated:
| Specify a formula/expression if any calculation needs to be done on the source fields and/or target fields. All fields should be prefixed with tableAlias, delimited with a dot (.) and wrapped in braces ( ). Below are the available formulas. |
Group By | Name(s) of the GROUPBY fields when the formula applied is of the GROUPBY function. Can be multiple names separated by a comma without spaces. Available values are SUM, AVG, COUNT, MAX, MIN. | Specify the groupBy field when the groupBy formula is used. Can be one or many, separated by a comma. |
Joining Key | Name of the Joining Source's field. (LEFT join is always applied on Source to Joining Source.) It is in the format "<tableAlias>.<sourceField>". | When there are multiple sources, specify which key joins the two sources, referred to by the format <tableAlias>.<sourceField>. Also the operator should be provided. The sources are all joined using LEFT_JOIN, so it is important to identify a primary source, so that all data from the primary source are extracted even if the other sources do not have joining key data. |
IsActive? | Flag to identify if the current row mapping is active (included in the calculation) or not. | Should be “Y”. Else the mapping row will not be visible to the Extractor. |
Operator | Operator to be used for either JoiningKey or Filter. Supported types are EQUAL, NOT_EQUAL, IN, NOT_IN, BETWEEN, NOT_NULL, NULL, LESS_THAN, GREATER_THAN, etc. | The operator should be provided in two cases (but not both cases at once):
|
Filter | Additional filter that can be applied on the source data. | Specify a value if any filtering needs to be done on the source field values. Works with operators. |
Seed for Masking | Seed value to mask the target field's value in the target. Only applicable when target field is of the String type. | Specify a seed if the target field’s value needs to be masked in the target DS. Only applicable when the target field is of the String type. The seed can be any string. |
The Primary Source is “Plasma_Quotes” DS, and it can be joined with any other sources to enrich the data in the “Plasma_Quotes” DS. Hence all the fields in Primary Source would need to be defined in the mapping.
Plasma_Quotes_SequenceControlTable
Defines the jobs and their order in one or more sequences.
Field Name | Comment |
---|---|
Sequence Name | Unique name of sequence (usually the Extractor name). |
Order | The order in which the particular jobs in a sequence are executed. |
Type | Sequence type (DL, CFS, etc.). |
Action Name | Name of the job (Label of DL, CFS, etc.) |
Status | Status of the sequence (DONE, PROCESSING, ERROR). If empty, this job will be executed next in the order. |
Last Run | Last processed run date time. |
DL Type | Type of the DL (Calculation, Refresh, etc.). |
Dl Target | Target name of the DL. |
Is active | Flag to identify if the current row configuration is active (included in the sequence) or not. |
Plasma Harvester CP Tables
This is not part of the customers partitions configuration.
Harvester gathers the standardized metrics from various customers' partitions using mapping from the configuration tables. Harvester is deployed on the Plasma partition. It combines the standardized metrics data with demographic entity details for each customer. It also anonymizes the complete data and writes it to Harvester Datamart.
Plasma_Quotes_Harvester_Mapping / Plasma_Transactions_Harvester_Mapping
Contains mapping of various customers' partitions, along with their details (bound partitions, filters, process date, etc.).
Field name | Description |
---|---|
Harvester Id | Unique Id of the Harvester to handle multiple mapping information. |
Harvester Name | Name of the Harvester. |
Harvester Description | Description of the Harvester. |
Source Name | Name of the source Datamart (for example Plasma_Output_Transactions). |
Destination Name | Name of the destination Data Source (usually Harvester Data Source). |
Bound Partition Name | Bound Partition name of the source. |
Unique Customer Id | Unique Id of the Harvester to match with the Dem_Entity field of the Plasma_Entities Data Source. |
Is Active? | Flag to identify if the current row mapping is active (included in the calculation) or not. |
Last Process (From) Date | Last processed date is automatically populated if the Harvester is run. It can be configured as FromDate to filter data. |
To Date | ToDate to filter data. |
Batch Size | Size of the batch that retrieves the data from the source partitions. |
Filters | Additional filter that can be applied on the source data. The filter is in the Map format. Example: {"_constructor":"AdvancedCriteria","criteria":[{"fieldName":"Dem_Business_Unit","value":"THERMAL","operator":"equals"}],"operator":"and"} |
Plasma_Quotes_Harvester_Validator / Plasma_Transactions_Harvester_Validator
Contains the fields and their default values if any of them are mandatory.
Field name | Description |
---|---|
Field Name | Name of the target field. |
Is Required? | Flag to identify if the target field is mandatory for the Harvester. |
DataType | Data type of the field. For future use. |
Default Value | Default value of the field (optional). |
Error Message | Error message (optional). |
Plasma_Quotes_Harvester_Audit / Plasma_Transactions_Harvester_Audit / Plasma_KPI_Audit
Contains the auditing information of each Harvester Id.
Field name | Description |
---|---|
Harvester Id | Unique Id of the Harvester to map back to Harvester_Mapping. |
Start Time | Start time of the Harvester. |
End Time | End time of the Harvester. |
Time Taken In Minutes | Time taken in minutes. |
Fetched Rows | Fetched rows. |
Processed Rows | Processed rows. |
Rejected Rows | Omitted rows. |
Status | Either SUCCESS or ERROR. |
Log Message | Log message in case of an error. |
HTTP Response Code | HTTP response code in case of an error. |
Plasma_Harvester_SequenceControlTable / Plasma_KPI_Distributor_SequenceControlTable
Defines the jobs and their order in one or more sequences.
Field Name | Comment |
---|---|
Sequence Name | Unique name of the sequence (usually the Extractor name). |
Order | The order in which the particular jobs in a sequence are executed. |
Type | Sequence type (DL, CFS, etc.). |
Action Name | Name of the job (Label of DL, CFS, etc.). |
Status | Status of the sequence (DONE, PROCESSING, ERROR). If empty, then this job will be executed next in the order. |
Last Run | Last processed run date time. |
DL Type | Type of the DL (Calculation, Refresh, etc.). |
Dl Target | Target name of the DL. |
Is active | Flag to identify if the current row configuration is active (included in the sequence) or not. |
Plasma_KPI_Refresher
Contains the Refresh information of the KPI Distribution.
Field name | Description |
---|---|
| Id of the bound partition Harvester. |
| Name of the bound partition. |
| Y/N flag showing if the data was loaded. |
| Y/N flag showing if the data was refreshed. |
| Day of the week chosen for the refresh. |
| Hour slot chosen for the refresh. |
Margin_Tracker_Config
Contains general mapping for Margin_Tracker.
Field name | Description |
---|---|
| Name of the configuration. Example: MonthsToCompare |
| Value of the configuration. Example: 12 |
Margin_Tracker_Audit
Contains the auditing information of Margin Tracker.
Field name | Description |
---|---|
Margin Tracker Id | Unique Id of the Margin Tracker. |
Audit Date Time | Audit time of the Margin Tracker. |
Status | Either SUCCESS or FAILURE. |
Message | Message of the audit. |