How can I export and import all data and metadata from a partition?
Question
This is helpful for everybody who wants to:
make a backup of their setup of the partition
set up quickly a new partition with some pre-defined/default setup and data
copy partition data and metadata to another partition
Answer
In Administration > Configuration > Import/Export/Archiving it is possible to export/import all data and metadata.
Excel Client can also export/import data and metadata, but always only for one table.
Pricefx Studio should be able to export/import Calculation Logic.
Automation Tools library has a lot of support for such operations.
See also Import / Export / Archiving.
Comments
Jul 23, 2019
(edited)
Jul 23, 2019
"Include Data" checkbox should be disabled for DS, DM - https://pricefx.atlassian.net/browse/PFCD-3933 (since Salty Dog)
Thanks for this write-up. However for complete partition data copy, I had to do additional steps. I owed mentioning it here and hence the comment.
This does not seem to be copying the data source and data mart tables even though the include data checkbox is checked. It may be because the data source contains millions of records and exporting it simply may create an issue during export. So using this option I definitely got non-DM and non-DS data. For DM and DS I used following:
a) First import all DS. Navigate to individual data source (Price Analyzer → Data Manager → Data Source), make sure you select filter for each DS such that no more than 500K records are selected. Note that typically date field allows you to make appropriate selection. The idea is figure out a way by which you can filter to get data incrementally exported using "Download CSV" format and then import it using option "Upload" available for each DS. After you finish importing do take time to validate that the count of records is matching in both sources.
b) Then Schedule the Data Loads the way they are done in the source partition and run them in destination partition. They are expected to populate the Data Mart. Also there is assumption that you have successfully imported the calculation logics before you start the data build up.