In Data Sources you can structure, clean up and validate data. It is a data container defined by the end-user to store specific master and transactional data, such as Customer master, transactional data (invoice line items) etc.

Default Data Sources

The following Data Sources are in Pricefx by default:

• Product – Product master data. Usually a copy of data from Price Setting.
  
• Customer – Customer master data. Usually a copy of data from Price Setting.
• uom – Unit of measure (needed to compare different units of measure and recalculate values, e.g. kg to gram). For details on UOM, see /wiki/spaces/KB/pages/30048258.
  
• ccy – Currency conversion table to recalculate money values to reporting currencies. For details on currencies, see /wiki/spaces/KB/pages/22183992.
  
• cal – Calendar to create week, month, quarter and year fields from the date fields. In every new partition, this Data Source is present. It is used for filling the Time Dimension columns in Datamarts (usually transactions) which are marked as Pricing Date (during refresh). By default this Data Source is empty. To generate rows for it, you need to run the Data Load DMDS.cal of the type Calendar. This Data Load is present by default as well. By default, this Data Load generates date rows 4 years back and 2 years to the future. This is configurable on the server. You should schedule this Data Load to run periodically, otherwise you will run out of dates some day in future.

Multiple Data Sources can be joined into Datamarts.

Loading Process

The data is loaded via the Data Feeds using Excel Client or File Loader. For each Data Source (once it is deployed), a Data Feed and Data Load are automatically generated. Loading into the source is actually loading into the staging table of that source – new records are not visible in the source until the staging table is flushed into source.

The current status is visible at the bottom of the Data tab. The source state possible values are: Draft, Pending (previously loaded data is being flushed), Scheduled, Processing, Scheduled dirty, Ready (all data flushed, source is up-to-date), Cancelled, Error.

If you click the 'Info' icon next to Status, you can see Data Load history from the staging table.

 If you have a large data set, you can disable automatic loading of the data grid content on the Data tab. Then you can set up a filter first and download only a subset of the data.

Notes

When working with Data Sources, the following applies:

• A name of a Data Source must not contain any spaces or special characters (only [a..z], [A..Z] and [0..9] are allowed).

• 'Name' and 'Label' are not editable for system-generated sources. 

• 'Name' is not editable for sources that have previously been deployed. 

• There is no other option than the Deploy action to save the Data Source in draft.

• Before you successfully activate the Data Source, the changes and additions are not available in Analytics.

• When deleting a Data Source, you need to delete the Data Feed in the Data Feed tab as well.

In Data Sources, you can also:

• Add Data Field in Data Source
• Set Data Entitlement in Data Source
• Sync Master Tables to Customer/Product Data Sources
• Create Materialized Rollups