CSV Data Loader
If you want to load structured or unstructured data from a CSV use the CSV data loader. Connect a BIM360 source to Aiimi Insight Engine to make the most of your data.
To complete this you must have a published Data Model for this data.
Connecting a CSV Data Loader with Aiimi Insight Engine
Source System: Select CSV Data Loader from the dropdown.
Input Files
In order to find the CSV files to load you need to complete the Input Files tab.
Folder Path: Enter the folder path for the CSV files location.
File Pattern: Enter a naming convention to when looking for CSV files.
You can use a wildcard to load multiple files within a path. For example entering *.csv will load all files with the extension .CSV from the folder path.
Complete Folder Path: Enter the folder where completed CSV files should be moved to.
Set to done by default.
Error Folder Path: Enter the folder where failed CSV files should be moved to. This makes it easy to find and investigate failed files.
Set to error by default.
Rows To Process: To run a limited number of rows as a test enter a limit.
If left blank all rows will be processed.
Field Delimiter: Select the field delimiter used for these files. Choose between Comma, Tab, Pipe or Semicolon.
The file will not process unless this is set correctly.
Multi-Value Delimiter: Select the multi-value delimiter for these files. Choose between Comma, Tab, Pipe or Semicolon.
The file will not process unless this is set correctly.
This must be different to the Field Delimiter.
Core Properties
You can configure the type for each file property. By default all properties will be undefined, you can choose between: Undefined, Value, Composite, Constant and Calculated.
Properties marked with a red asterisk * require definition.
Core Property List: Select the property you want to define.
Property Details: On the right, choose the property type from the dropdown.
Depending on the property type selected you may need to define more.
Undefined
These fields will not be mapped.
Value
Select the Column to map this field to.
Composite
Create a string using text and numbers within curly brackets {}. Add the components of the string and select the inputs that will sit in place of the numbers once processed.
Constant
This populates a field with the same text value no matter what.
Calculated
This enters either the current date or Current date and time into a field.
This is the time of the load running.
Model Data Attributes
To connect a field from the file to an attribute in a data model you need to run a file with 3-5 data rows for validation. This will pull in all the field labels from the file. Once run you can then complete the mappings the same way as core properties.
Business Model: Select the relevant Business Model.
Property List: Select the property you want to define.
Property Type List: Choose the property type from the list on the right.
Depending on the property type selected you will need to define more.
Undefined
These fields will not be mapped.
Value
Select the Column to map this field to.
Composite
Create a string using text and numbers within curly brackets {}. Add the components of the string and select the inputs that will sit in place of the numbers once processed.
Constant
This populates a field with the same text value no matter what.
Calculated
This enters either the current date or Current date and time into a field.
This is the time of the load running.
Validation
Once everything is defined you can run the test file once more to check the fields and data are mapped correctly. If they are not go back to Model Data Attributes or Core Properties to correct them.
Upload: Drag and drop a file for validation or select Upload Here to find a search for a file.
Validate: Once loaded, select validate.
This can be run multiple times until you are happy with the selections.
Completed the Source section
Once you have completed this section, select Crawl. Learn how to complete the source Crawl set up.
