Data Manager allows you to upload and manage all the data in Analytics. 

You will work here with the following entities: 

• Data Feed – Loads raw data. 
• Data Source – Data container for structured, clean data, e.g. Customer master data.
• Datamart – Data container generated by Pricefx, can combine multiple data sources.

• Data Loads – Loads data among these entities.

Data Flow in Detail

The data flow in Data Manager is as follows:

1. Raw external data is loaded into a Data Feed from an external source:
   • Via the Server REST API using:
     • IntegrationManager – Pricefx application
     • Customer's own software
   • By an Excel file upload (directly via user interface in Data Manager).
   Data Feed data can be unstructured (all the columns are strings) and can include unwanted or duplicate data (there are no key columns).
2. Data Load Flush – With the Flush Data Load, the data is loaded into a Data Source. You can use a calculation logic to structure, clean up and validate the data.
   A Data Source always has a key – it cannot contain duplicate data. Also, all columns have strict data types (like Number, String, Date, etc.).
3. Data Load Refresh joins together different Data Sources into a Datamart, based on one or more keys.
4. Additional values can be calculated in the Datamart using expressions at query time or via a special Calculation Data Load using a logic.

Notes

Data Load Calculation

The usual purpose of a calculation is enrichment, i.e. calculate additional fields in rows already loaded in the Datamart but it is also possible to use Data Load Calculation to move data from a Data Source to a Datamart (while calculating additional values with a logic more complex than in Datamart expression). 

There are a few points to consider:

• The calculation will have not have a Data Source as a source. The "source" DatamartRowSet will be the Datamart itself.
• When you want to source data from a Data Source, to load them in the Datamart you will need to both query the Data Source and to use the "target" DatamartRowSet's addRow(map) method.
• This way a Datamart can be entirely populated by a logic (sourcing the required data using api.finds, Analytics queries etc.).
• But you cannot use the 'free' joining of source Data Sources and also the incremental load mechanism (i.e. you need your logic to do all that, if required).

Hidden Fields

By default, hidden fields are not queried and displayed in the data tables.

If you still want to have them displayed, set the Advanced Configuration Option paShowHiddenFieldsInDataGrid to true.