Configure Product Data Source

In this article you will learn how to configure the Product Data Source table. This table exists out-of-the-box, so you only need to configure its fields. As the fields need to be synchronized with the Product Master table, the whole configuration is reduced to a simple action.

The configured Product Data Source can look like this:

Configure Data Source Fields

Navigate to Analytics › Data Manager › Data Sources. You will see all the existing Data Source tables including the out-of-the-box table called Product.

Figure 1. List of existing Data Source tables

Click the Data Source label Product to open its detail. The detail page opens, showing you the fields of Product Data Source.

Click the button Sync Meta Data. If you cannot see the button, then review the actions under the three-dots button. The list of fields will be copied from / synchronized with fields of the Product master table (found under MasterData Products). So you need to first configure the Product master table before configuring this Data Source.

Click Deploy button to deploy the changes of fields names and types to the database. If you cannot see the button, then review the actions under the three-dots button.

A confirmation dialog named Comparison will display – to show you the differences between the current and future version of the table metadata. Click Deploy to confirm the change.

Review the new metadata – notice that the column Function has now a database icon which tells you that this field is now available in the database table.

Fetch Data Source Product Fields Metadata to Your Project

If you already have your project set up in IntelliJ and you also have the connection to a partition set up, fetch the new fields metadata to your project.

Copy Data from Product Master to Product Data Source

In many scenarios, the data will get to the Product Data Source as a copy of data from the Products master table.

To copy the data, navigate to Analytics › Data Manager › Data Loads.

Find the Data Load with Target DMDS.Product and Type Internal Copy, and click the link in Label to open the detail of the Data Load.

Click Run Data Load. This action will schedule the task for execution, but the task does not start immediately – expect up to 1 minute of delay.

Use Refresh in the Job/Task Tracking section to see if the status of the task has changed to Ready.

You can also schedule this process to be done regularly (via the Add Task button), or you can start this Data Load from the data integration tool like IntegrationManager just after you uploaded new data into the Product master.

Once the process finishes (status is Ready), review the data in the Data Source.

Navigate to Analytics › Data Manager › Data Sources.

Click the Product label to open the detail of the Product Data Source.

Open the tab Data and use the Refresh action to refresh the data from database.

You can also revisit the page MasterData › Products to see if the list of products in the Data Source matches the original table.