Data Feeds

Data Feed table allows you to upload raw data which is potentially not in a good condition (bad formatting, ...) and can include unwanted or duplicate rows. Data in the Data Feed is then cleaned with a Data Load process and uploaded into a Data Source.

A Data Feed is created automatically for each deployed Data Source, with an auto-generated name, generic field names (attributeX) and a label (DS.label). The data type is always text to prevent data type conversion issues (manipulation with the data comes later, in Data Loads).

Click the Data Feed's label to display its details. Each details page has two tabs:

  • Fields tab – Here you can:

    • Edit the Data Feed's label.

    • Define the Field Separator if the data file that you intend to upload uses other than the default delimiter (comma). You must (re)deploy the Data Feed for this change to take effect.

    • Add fields from a data sample (CSV, XLS) to create a data structure for later data import. Use the Field Picker section to select which from the automatically identified fields you want to add to your Data Feed.

    • Import or export Data Feed definitions in the JSON format.

    • Delete selected fields.

     For a comprehensive example of using this tab, see How to Upload CSV Data into Analytics.

  • Data tab – Here you can see all uploaded raw data and upload new data using the Data Load action. You can choose from:

    • Truncate – Deletes all/filtered rows from the Data Feed.

    • Upload – Loads an XLS/XLSX sheet or a CSV/TXT file. Note that the size limit is 1 GB.

    • Mass Edit – Allows you to apply mass changes to editable attributes.

    • Status History – Shows information on the Data Feed status history – a list of Data Feed actions that have been executed.

    • Export Excel, CSV – Exports the Data Feed data to the XLSX or CSV format. For data tables containing a large amount of data, asynchronous download is available.

     If you have a large data set, you can disable automatic loading of the data grid content. Then you can set up a filter first and download only a subset of the data.

Note on Last Update Date

When you run the operation Data Feeds to Data Source FLUSH and lastUpdateDate is present in the source (DF) data, the date is copied into the Data Source.

When lastUpdateDate is missing in the Data Feed data, the usual method applies – lastUpdateDate is set to the job's calculation start date.

Found an issue in documentation? Write to us.

 
Pricefx version 12.0