Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info
Since version 10.0

You will use a Distributed Calculation Dataload when you need to:

  • Enrich/process a Datamart, Data Source or Data Feed with big amount of data, for example to:

    • Add new records - copy and transform data from other table to this table.

    • Modify existing records - pre-calculate values, which were not imported from an external system, but are needed for analysis and their calculation takes too long to be done on demand.

Note, that the Distributed Calculation Dataload can be still set NOT to be executed in the distributed mode. The use-cases could be, for example:

  • The processing cannot be split up to batches and executed concurrently, because of dependencies between the rows. You may need to iterate over the rows in given order to track price changes.

  • Replace the legacy Calculation Dataload with quite a bit faster version.

  • You need to test the process and would like all to run in the same thread.

...