Productsup
Dataflow

Work with the Dataflow toolbar

Dataflow: Discover how you can organize data with the help of the advanced features in Dataflow in Productsup.

23 min read

The Dataflow toolbar gives you tools to find attributes and rule boxes, map attributes automatically, manage versions, adjust the view, and delete connections, rule boxes, or attributes in bulk. You can access these tools from the upper ribbon above the Dataflow stages:

Dataflow toolbar above the import, intermediate, and export stages

The features let you perform the following actions:

  • Export selection lets you select one of the exports added in Exports.
  • Preview unfolds a panel on the left-hand side of Dataflow and displays the values of the imported attributes.
  • Filter attributes unfolds the search fields of the import, intermediate, and export stages to let you search for needed attributes.
  • Automap connections lets you choose among the options for automapping the attributes between the stages.
  • Filter rule boxes lets you look up certain rule boxes applied to your attributes while hiding those that do not match the search keywords.
  • Versions stores all versions of your Dataflow and lets you retrieve a necessary version in case of an issue.
  • View lets you hide or reveal specific attributes and specify the sorting order for attributes in the import, intermediate, and export stages.
  • More lets you remove rule boxes, custom attributes, or connections between attributes in bulk.
  • Rule Box Conditions lets you create and set up conditions to determine when the platform should apply rule boxes to an attribute.

The following sections describe each feature in detail.

Select an export

The export selection button lets you choose one of the exports you have already added in Exports.

Export selection drop-down menu in Dataflow listing the exports added to the site

To select an export:

Go to Dataflow from the site's main menu.

Select the export selection drop-down menu in the upper ribbon.

Select the export where you can map attributes or apply rule boxes.

Preview import data

The Preview button shows a preview of imported attribute values to help you map your attributes more accurately.

To open preview:

Go to Dataflow from the site's main menu.

Select the Preview button in the upper ribbon. An additional section with the attribute's values opens on the left of Dataflow.

Use arrows to switch between the items. Each page represents the attribute values of one item. Preview panel on the left of Dataflow showing the import attribute values of one item

If your import stage contains many attributes intended for different exports, it can be challenging to map attributes. To ensure you are mapping the correct attribute, instead of switching between the pages, you can search for a known attribute's value to view the item associated with it and make a better mapping decision.

To search for an attribute's value:

Select Preview.

Select the magnifier icon Magnifier icon next to the necessary value.

In the Attribute value search pop-up window, enter a value for an attribute in the Search value field. Attribute value search pop-up window with the Search value field

Select Search. The item page containing the search value opens.

To hide the Preview panel in Dataflow:

Select the Preview button in the upper ribbon again.

Find an attribute in the stage

The Filter attributes button lets you find a specific attribute in the import, intermediate, or export stages.

Button for filtering attributes in the Dataflow toolbar

To find a specific attribute in one or all stages:

Go to Dataflow from the site's main menu.

Select the Filter attributes button in the upper ribbon.

Enter the needed attribute name in the search field of the specific stage. Search field of the import stage filtering the attributes by name

Map attributes with Automapper

You can connect attributes between stages one at a time or with Automapper. Connect attributes one at a time when you have a few to map. See Use Dataflow to map your attributes from import to export. Use Automapper when you want to map a whole stage at once. Automapper connects attributes in seconds using exact name matching, dictionary, or AI suggestions.

You can map attributes from import to intermediate and from intermediate to export.

Automapper only maps unconnected attributes. If an attribute already has a connection, Automapper leaves it as is.

To use Automapper:

Go to Dataflow from the site's main menu.

Select Automap connections in the upper ribbon. Automap connections drop-down menu with the automapping options

Choose an option from the drop-down menu:

  • Import to intermediate maps the attributes between the import and intermediate stages.
  • Intermediate to export (all intermediate attributes) maps all intermediate attributes between the intermediate and export stages.
  • Intermediate to export (only attributes connected to import) selects only the attributes mapped to import and maps them between the intermediate and export stages.
  • Map all import attributes to export maps the attributes from the import to export stage. If the names of the attributes do not match, the platform creates custom attributes at the relevant stage. The attribute order does not change in your export file, although the platform arranges the attributes alphabetically in your Dataflow view.

The AUTOMAPPER pop-up window opens to let you specify your mapping possibilities.

In step 1, select the automapping method: Step 1 of the Automapper pop-up window with the settings for direct, dictionary, and predicted matches

  1. Direct matches maps attributes that are exactly the same in both stages. The matching is case-insensitive. For example, ProductTitle may match producttitle. The drop-down has the following options:
    • Yes means that the direct matching is active. It is the default selection.
    • No means that the platform ignores the direct matches and uses other automapping methods.
  2. Dictionary matches maps the attributes using the platform's internal dictionary. The drop-down has the following options:
    • Yes means that the dictionary matching is active. It is the default selection. When set to Yes, the Confidence scale becomes active and lets you change the matching accuracy. Set lower confidence rate to get more matches that are less accurate or set higher confidence rate to get fewer but more exact matches. By default, Confidence is 80%. You can see the results in the next step.
    • No means that the platform ignores the dictionary matches and uses other automapping methods.
  3. Predicted matches maps the attributes with the help of an AI model. When selected, this method matches only the attributes that remain unmapped after the direct or dictionary matching. The drop-down has the following options:
    • Yes means that the predicted matching is active. If you select Yes, the Confidence scale becomes active and lets you change the matching accuracy. Set lower confidence rate to get more matches that are less accurate or set higher confidence rate to get fewer but more exact matches. By default, Confidence is 80%. You can see the results in the next step.
    • No means that the platform ignores prediction matches and uses other automapping methods. It is the default selection.

In step 2, you can see all mapping suggestions from the previously selected automapping methods. By default, the platform marks all the suggestions as selected, but you can deselect those that you think are irrelevant. When you are ready, select Apply and finish to confirm the mapping. Step 2 of the Automapper pop-up window listing the suggested matches and the Apply and finish button

A pop-up window opens, informing you that applying the mapping changes your current Dataflow and that you can only revert it by restoring a previous version or removing each mapping manually. Warning pop-up window asking whether to save your current Dataflow as a new version before applying the mappings

  • Select Yes to save your current Dataflow as a new version before the platform applies the mapping. This lets you roll back to this version later if needed.
  • Select No to apply the mapping without saving a version.
  • Select Cancel to close the pop-up without applying the mapping.

Find an applied rule box in Dataflow

The Filter rule boxes search field lets you look up certain rule boxes applied to your attributes while hiding those that do not match the search keywords.

Search field for filtering rule boxes in the Dataflow toolbar

To find an applied rule box:

Go to Dataflow from the site's main menu.

Enter the name of the rule box you want to search for or a keyword associated with it in the Filter rule boxes search field. The platform hides all non-matching rule boxes from Dataflow and shows only those that match your search term.

Manage versions in Dataflow

As you edit and adjust elements in your Dataflow, it is helpful to save versions of your Dataflow before testing something or making major changes so that you can roll back to earlier versions in case of a problem.

Dataflow automatically saves versions before you commit significant changes, such as deleting all connections. But you can also save versions manually.

You can see the list of saved versions by selecting the Versions button in the upper ribbon.

Versions button in the Dataflow toolbar

To save a new version of Dataflow:

Go to Dataflow from the site's main menu.

Select Versions.

Select Save dataflow version. Versions drop-down menu with the option to save the current Dataflow as a new version

In the pop-up menu, enter the version's name and leave a comment (optional). Add version pop-up window with the Version name and Comment fields

Select Save. The Versions drop-down menu now includes your saved version.

There are several icons to the right of each saved version.

Saved version in the Versions drop-down menu with the icons to view the comment, edit the version, and delete it

These highlighted icons let you perform the following actions:

  • View a comment.
  • Edit a version name or comment.
  • Delete a version.

To retrieve a version of Dataflow:

Select Versions.

Select the version you wish to retrieve.

Select Yes to save your current Dataflow version before loading a previous version.

Caution

Loading one of the previous Dataflow versions overwrites the current version. If you continue without saving your current Dataflow version, you lose all Dataflow changes for all exports in the current site performed since the last saved version.

Sort by attributes

The Sort by drop-down menu under the View button lets you define the order of attributes to appear in Dataflow. It does not affect the order of the attributes in the final export. It only customizes your view in Dataflow.

Sort by options under the View button in Dataflow

To access sorting options for attributes:

Go to Dataflow from the site's main menu.

Select the View button in the upper ribbon.

Select Sort by.

Choose your option from the drop-down list:

  • Connected attributes shows connected attributes at the top.
  • Attribute name makes attributes appear in alphabetical order, from A to Z.
  • Import order makes attributes appear in the import stage in the same order they appear in your data sources.
  • Import order and connections makes attributes appear in the import stage in the same order they appear in your data source. The connected attributes come first.
  • Export order makes attributes appear in the export stage in the order they appear in the export file.
  • Raw Import & Export Order makes attributes appear in the import and export stages in the order they appear in the data source and exports.

Hide or show attributes

The Hide/Show drop-down menu under the View button lets you customize the Dataflow view by hiding irrelevant information to be able to focus on specific stages or attributes:

Hide/Show options under the View button in Dataflow

To hide or show the attribute data:

Go to Dataflow from the site's main menu.

Select View in the upper ribbon.

Select Hide/Show.

Select a type of data that you want to hide or show. Choose one of these options to have the following effect:

  • Hide unconnected attributes hides all unmapped attributes.
  • Hide connected attributes hides all mapped attributes.
  • Hide import stage hides the entire import stage.
  • Hide export stage hides the entire export stage.
  • Hide warning connections hides all red warning connections, for example those that appear after you import Dataflow from another site.

    A warning connection is a red line between two stages in Dataflow. A warning connection appears when there is an active connection between the attributes in the import and intermediate stages, but the connected attribute does not exist in the import stage. To delete these warning connections in bulk, together with connections from import attributes that have no values, see Remove connections to empty import attributes. You can also see a warning connection if the rule box applied to this connection does not have the required attribute value.

  • Hide Attributes without Values hides all attributes with empty values.
  • Display Attributes from Datasources lets you choose the main or additional data sources whose attributes you want to see in Dataflow.
  • Column Views lets you select a custom Dataflow view previously created in Data View. See Save custom views. Column views pop-up window with a view selector for the import, intermediate, and export stages
  • Attribute Width lets you regulate the width of the stages to let you see the attribute names in full.

Delete attributes, rule boxes, or connections

The Delete button under the More drop-down menu lets you delete rule boxes, custom attributes, or connections between attributes in bulk.

Delete option under the More button in Dataflow

To delete multiple attributes, rule boxes, or connections:

Go to Dataflow from the site's main menu.

Select More in the upper ribbon.

Select Delete.

Select the option you want to apply from the drop-down menu. Delete menu in Dataflow with options for connections and rule boxes, rule boxes, connections to empty import attributes, and unconnected user-generated attributes

SectionMenu itemExplanation
Connections and rule boxesImport – intermediateDelete all connections between the import and intermediate stages, together with their rule boxes
Connections and rule boxesIntermediate – exportDelete all connections between the intermediate and export stages, together with their rule boxes
Connections and rule boxesAllDelete all connections across all stages, together with their rule boxes
Rule boxesImport – intermediateDelete all rule boxes for the attributes between the import and intermediate stages
Rule boxesIntermediate – exportDelete all rule boxes for the attributes between the intermediate and export stages
Rule boxesAllDelete all rule boxes for all attributes across all stages
ConnectionsConnections to empty import attributesDelete the connections from import attributes that are missing from your latest import or have no values for any item, optionally with their rule boxes (see Remove connections to empty import attributes)
User-generated attributesRemove unconnected (intermediate)Delete all unconnected custom attributes at the intermediate stage
User-generated attributesRemove unconnected (export)Delete all unconnected custom attributes at the export stage

Remove connections to empty import attributes

The Connections to empty import attributes option deletes connections from import attributes that no longer provide data, so you do not have to delete them one by one. It covers two kinds of connections between the import and intermediate stages:

  • Red warning connections, which appear when an attribute disappears from your import feed
  • Connections from import attributes that are still in your import feed but have no values for any item

The platform checks both against the site's latest import. By default, the platform keeps every connection that has rule boxes. It deletes those connections and their rule boxes only if you select this option in the dialog.

To remove connections to empty import attributes:

Go to Dataflow from the site's main menu.

Select More in the upper ribbon.

Select Delete.

Under Connections, select Connections to empty import attributes.

In the Warning dialog, choose which connections to remove:

  • Only connections without rule boxes removes the connections that have no rule boxes and keeps the rest. This is the default option.
  • All connections, including their rule boxes removes all these connections and the rule boxes applied to them.

Keep the default when you want to review which connections have rule boxes before you delete them. Select All connections, including their rule boxes when you no longer need the rule boxes on any of these connections.

Warning dialog with the options to remove only connections without rule boxes or all connections including their rule boxes

If you selected All connections, including their rule boxes, keep Save a version before removing selected to save a version of your Dataflow first. The platform names this version Before removing warning connections. If the platform cannot save the version, it does not remove anything.

Select Remove.

If the platform removes all these connections, Dataflow reloads to show the result. If you saved a version, a notification confirms that you can load it from the versions list.

If you selected Only connections without rule boxes and some connections have rule boxes, the dialog lists the attributes the platform skipped. The platform removes all other connections. Close the dialog to see the result in Dataflow. To remove the skipped ones, repeat the steps and select All connections, including their rule boxes, or delete each connection individually. See Delete attribute connections.

Caution

All connections, including their rule boxes permanently removes the rule boxes applied to these connections, including their schedules. Loading the version the platform saved before removing restores the rule boxes but not schedules for specific days, which versions do not store. Loading a version also replaces your whole Dataflow, so you lose any changes made after the version was saved. See Manage versions in Dataflow and Schedule rule boxes to run at a specific time.

Messages when the platform cannot remove connections to empty import attributes

When you select Connections to empty import attributes, the platform does not remove any connections in the following cases. Instead, the Warning dialog shows a message:

SituationMessage in the dialog
Your Dataflow has no connections to missing or empty import attributesNo warning connections to remove.
Your site has no import yet, so the platform cannot tell which attributes are missing or emptyNo import attributes found. Run an import first.
Your site uses an intermediate stage shared from another site, so you cannot remove these connections in bulk on either siteThis intermediate is shared from another site. Remove its warning connections there.
Your site shares its intermediate stage with other sites, whose imports may still contain the attributeThis intermediate is shared with other sites, so its connections cannot be removed here.
You chose to save a version first, but the platform could not save itThe version could not be saved, so nothing was removed.

See Share dataflow with other sites to learn more about shared intermediate stages.

On this page

Still stuck?

Reach out to our support team and we’ll help you get unstuck.

Contact support