Edge Import - Create/Edit Data Load

The New Load page enables you to either perform a one-time bulk import or validate your data. Following the validation or data load, an overview of the process is displayed.

To create a new data load, go to Admin > Tools > Edge > Imports and Feeds. Select the Loads panel. Then, select the New Load button. This opens the New Load page.

Edge Import Migration Guides

Edge Import Starter Guides

Limits and Best Practices

What is the max file size limit for Edge Import and how can I reduce the impact?

New Load

  1. Category and Type - From this drop-down menu, select the data type that applies to the data you are loading. This drop-down only includes the data import types for which the administrators has permission to access. For example, the Employee Salary load type only appears if the administrator has the Load Employee Salary permission.
  2. Configuration - In this field, you have two options for selecting a configuration for your data load. Note: Administrators must have the appropriate permissions to modify or create a configuration.
    1. From the drop-down menu, select the configuration that most closely matches your data. You can modify the default Options and Mapping settings from the configuration for your data load by selecting the Modify button, but the modifications are not saved to the selected configuration.
    2. If none of the available configurations match your data, then select the New Configuration button to create a new configuration. See Edge Import - Create Data Import Configuration.
  3. Encryption Key - From this drop-down, select the encryption key that is used with the data load. Encryption keys are created on the Manage Keys page. See Key Management - Manage Keys.
  4. Select File - In this field, select the file that contains the data that you are loading. See the File Format Information section below for additional information. Files can be selected in the following ways:
    1. Pick a File - Pick a file from your computer by dragging and dropping a file into the field or by selecting the Pick a File button to browse for and select a file from your computer. With this method, the maximum file size is 20 MB.
    2. Select from FTP - Select a file from your Cornerstone FTP location by selecting the or load a file from FTP link. Then, specify the FTP path. All paths are relative to the FTP directory. If the file is located in the root of the FTP directory, only the file name needs to be provided. With this method, the maximum file size is 25 GB for .xls, .xlsx, .csv and .txt files. Up to 150 columns (data feed) and 300 columns (manual load) can be loaded per file. The number of records you can load varies by environment and load type, and are listed in the template guides for each load.

Once the file is loaded and the settings are configured, you have two options:

  • Select the Validate Only button to only validate that your data is in the correct format and does not contain errors. When this button is selected, the Validation Details are displayed. See the Validation Details section below for additional information.
  • Select the load button to validate the data and load it to the system. See the Load Details section below for additional information. Note: Depending on the portal configuration, if an administrator has only validated their data, another administrator may not able to perform a data load for this data unless they have the appropriate permission.

Validation Details

When you choose to only validate your data, the system analyzes the selected file, and the Validation Details provide an overview of the validation.

The Record Details chart provides a visual overview of the validation progress and the number of records in each status. While data is being processed, the data is displayed as a bar graph. Once the data is fully processed, the data is displayed in a pie chart.

The Information section displays the following details about the validation or load:

  • Category
  • Type
  • File Name
  • Configuration - Select the View link to open a flyout that displays the Options and Mapping settings from the configuration.
  • Validated By/Loaded By - This displays the name of the user who initiated the validation or load.
  • Started - This displays the date and time at which the validation or load began.
  • Completed - This displays the date and time at which the validation or load completed.

The Quick Stats section displays reports that can be downloaded.

  • Valid Records - This displays the number of valid records that were processed. Valid records may be processed successfully or with warnings. Any warnings are displayed in the downloaded report so that you can adjust the data, if necessary, prior to loading it.
  • Not Valid - This displays the number of invalid records that were processed. Any errors are displayed in the downloaded report so that you can adjust the data and then load it.
  • Total - This displays the total number of records that were processed.

To download a report, select the record count in the Download column. Note: Depending on the portal configuration, administrators may only download a report for loads that they performed unless they have the appropriate permission.

The Warning Details section appears if your records have any warnings. This section displays any warnings that occurred and the number of records that encountered the warning.

The Error Details section appears if your records have any errors. This section displays any errors that occurred and the number of records that encountered the error.

Select the Load button to load the data to the system. Note: Depending on the portal configuration, administrators may only perform a data load for data that they validated unless they have the appropriate permission. See the Load Details section below for additional information.

Load Details

When you load your data, the system analyzes the selected file and then attempts to load the data. The Load Details provide an overview of the load.

The Record Details chart provides a visual overview of the load progress and the number of records in each status. While data is being processed, the data is displayed as a bar graph. Once the data is fully processed, the data is displayed in a pie chart.

The Information section displays the following details about the validation or load:

  • Category
  • Type
  • File Name
  • Configuration - Select the View link to open a flyout that displays the Options and Mapping settings from the configuration.
  • Validated By/Loaded By - This displays the name of the user who initiated the validation or load.
  • Started - This displays the date and time at which the validation or load began.
  • Completed - This displays the date and time at which the validation or load completed.

The Quick Stats section displays reports that can be downloaded.

  • Loaded - This displays the number of valid records that were processed and loaded. Valid records may be processed successfully or with warnings. Any warnings are displayed in the downloaded report so that you can adjust the data, if necessary, prior to loading it.
  • Not Loaded - This displays the number of invalid records that were not loaded. Any errors are displayed in the downloaded report so that you can adjust the data and then load it.
  • Total - This displays the total number of records that were processed.

To download a report, select the record count in the Download column. Note: Administrators can only download a report for a load they did not perform if they have permission to access the associated data load type. Depending on the portal configuration, administrators may only download a report for loads that they performed unless they have the appropriate permission.

The Warning Details section appears if your records have any warnings. This section displays any warnings that occurred and the number of records that encountered the warning.

The Error Details section appears if your records have any errors. This section displays any errors that occurred and the number of records that encountered the error.

Frequently Asked Questions (FAQs)

File Format Information

The following file types are supported:

File Type Details
Text File
  • File name is flexible
  • File extension: .CSV or .TXT
  • Columns names are flexible
  • One row equals one record
  • Supported Delimiter: TAB, COMMA or PIPE
  • File should be UTF-8 encoded - Note: When using accented or umlaut characters in data feeds, files should be UTF-8 encoded with BOM (Byte Order Mark) to ensure the characters display properly in the system.
Excel File
  • File name is flexible
  • File extension: .XLS or .XLSX
  • Columns names are flexible
  • One row equals one record
  • Only one worksheet can be loaded at a time

PGP and GPG encrypted files are supported for data feeds and one-time loads. It is important to note that when encrypted data is loaded, the data in the load report is also encrypted. It is recommended to keep a copy of the original plain text file before encryption from your source data system.

Edge Import supports text and Excel files with and without column headers. The first row in the file should be the header with column names. As a best practice, use column headers to make the configuration and maintenance process more user-friendly and less vulnerable to errors.

Validation Tips

  • For non-translation loads, each row needs to be unique.
    • Examples: For employees, this could be User ID or GUID. For OUs, this is the OU ID.
  • If more than one record contains the same identity value, the first record will be loaded, and the other records will be marked as duplicate (error).
  • Required columns must have a valid value.
  • Values need to be acceptable and comply with the maximum field size, follow the latest template guide.
  • For enumerated fields, the ID or Code must match the values listed in the relevant template guide.
  • Optional fields with invalid data will be omitted, but the record itself will be loaded and logged with warnings.
  • Ensure that the format of cells in Excel files are correct.
    • The cell must be in text format for a number that starts with "0.". Example: "00123" must be provided in a cell formatted as 'Text.' If the cell format is defaulted by Excel as 'Number,', it will be incorrectly saved as "123".
  • IDs associated to a record must match an existing unique ID value that’s already in the portal or is provided for creation in the current load file.