logo

NJP

IH-ETL Guided Setup Step 2 - Preview and Prepare Data

Import · Nov 15, 2021 · article

Previous Step

IH-ETL Guided Setup Step 1 - Basic Detail

In this step, you can preview the raw data pulled from data source and apply data transform operations if necessary (e.x. copy, to lower/upper case). Below is an example configuration:

1. Click “Preview and Prepare Data”

image

This displays a table that shows your existing data from the Import Set selected earlier.

image

From here you can create any new transformation you might need. This can include operations such as:

  • Combining columns to create unique ids
  • Extracting a name from a fully qualified domain name
  • Replacing – in a MAC address with : to match a recommended format
  • Specifying a specific hardware class based on attributes of the input
  • Splitting make and model into separate fields

2. To create a new operation, click the menu button next to any column header and select “New Transform”

image

This opens the “New Transform” sidebar

image

3. As an example, select “Concatenation” as your Transform type

image

4. Add an additional input column of “u_mac” then set the description and name

5. Set a separator by setting “||” in the “Concatenate with string” field

image

6. Click “Apply” to see your new column

image

7. Click “Mark as Complete”

image

image

For nested data format, we provide additional functions

IH-ETL nested payload feature demo 4:15 - 11:05

Tips and Caveats

  • Preview the data pulled from import set associated in the basic details section
  • By default, IH-ETL will only preview 100 rows of data from data source. Use property “sn_int_studio.preview.size” to control the number (max 10k)
  • select Ignore in Mapping to exclude the column from mapping and integration in the current session

image

Additional Resources

Landing page

IH-ETL common error scenarios

Next Step

IH-ETL Guided Setup Step 3 – CMDB Class Mapping

View original source

https://www.servicenow.com/community/cmdb-articles/ih-etl-guided-setup-step-2-preview-and-prepare-data/ta-p/2301329