Aiimi Insight Engine
User GuidesAiimi
  • Introducing Aiimi Insight Engine
  • Architecture
    • Overview and Key Concepts
    • Search Flows
      • Search Flow Types
      • Smart Filtering
      • Query and Prompt Classification
      • Search Algorithms
      • Extractive and Generative Models
    • Hosting Options
    • Architecture and How It Works
      • Agent Servers
        • Security Agent
        • Source Agent
        • Content Agent
        • Enrichment Agent
        • Job Agent
        • OCR Agent
        • Migration Agent
        • Tika Agent
      • Repository
        • Data Node
        • Proxy Node
        • Kibana Node
      • Gateway and User Interface
      • Document and Data Sources
    • Deployment Options
    • Security
      • User Security
      • Data and Document Security
      • Source System Security
      • Firewalling
      • Agent Servers
      • Repository
      • Gateway (Web Server)
      • Tools & Utilities
  • Installation
    • Elastic and Kibana Install (Windows)
    • Aiimi Insight Engine Installation (Windows)
      • Installation Security
      • Certificates in a Key Vault
      • SAR Configuration
      • CSOM Bridge Set Up
      • AI Studio
    • AI Services
      • Prerequisites
      • AI Enrichment Service
        • Installation and Setup
        • Enabling Enrichment Steps
        • Using AI Enrichment Steps
        • Performance and Concurrency
      • AI Model Service
        • Installation and Setup
        • Enabling Providers
        • Private Generative AI
        • Azure Open AI
        • Enabling AI History
        • HTML Cleaner Service
      • Configuration of Logging
      • Offline Set-up of Models
      • Using SSL
      • Running as a Service (Windows)
      • Using GPUs
      • AI and Semantic Search Set Up
        • Open & Closed Book AI
        • Semantic Search
          • Vectors for Semantic Search
          • Source Configuration
          • Sentence Transformer Models
          • Enrichment
          • Kibana
          • Final Search Flow
    • Email Threading Upgrade
  • Run Books
    • SharePoint Online Connector
  • Control Hub
    • Configurations
      • Config Management
      • Security Configurations
        • Security - General
        • Security - Source
          • Active Directory
          • Atlassian
          • Azure Active Directory
          • Builtin Security
          • Miro Security
          • Google Directory
          • Slack Security
        • Security - Sync
        • Security - Agents
        • Security - Scheduling
      • Source Configurations
        • Source - General
        • Source - Source
          • Alfresco Kafka
          • Azure Blob Storage
          • BBC Monitoring
          • Big Query Cataloguer
          • BIM360
          • CSV Data Loader
          • Confluence
          • Content Server
          • Data File Cataloguer
          • Document Store
          • DocuSign
          • Dropbox
          • Exchange 365
          • Filesystem
          • Google Bucket
          • Google Drive
          • Google Vault
          • Jira
          • JSON Data Loader
          • Livelink
          • MFiles
          • Microsoft Teams
          • Mimecast
          • Miro
          • ODBC Data Loader
          • PowerBi Cataloguer
          • Reuters Connect
          • ShareFile
          • SharePoint
            • Azure Portal and Azure AD Authentication
            • Sensitivity Labels
          • SharePoint Legacy
          • SQL Server Cataloguer
          • Slack
          • Versioned Document Store
          • Websites
          • XML Data Loader
        • Source - Crawl
        • Source - Agents
        • Source - Schedule
        • Source - Advanced
      • Enrichment Configurations
        • Creating a Pipeline
          • General
          • Steps
            • AccessMiner
            • AI Classification
            • Anonymiser
            • CAD Extractor
            • Checksum
            • Content Retrieval
            • Copy
            • Data Rule Processor
            • Delete
            • Email Extractor
            • Entity Rule Processor
            • External Links
            • Geotag
            • Google NLP Extractor
            • Google Vision Extractor
            • Metrics Calculation
            • Microsoft Vision Extractor
            • OcrRest
            • Office Metadata
            • PCI Extractor
            • REST
            • Set Document Risk
            • Text Cleaner
            • Tika Text Extraction
            • Trie Entity Extractor
            • Update Metadata
          • Filters
          • Agents
          • Schedule
          • Advanced
      • OCR Engine
      • Job Configurations
        • General
        • Job
          • AutomatedSearchJob
          • Command Job
          • ElasticJob
          • Extended Metrics Job
          • File Extractor
          • GoogleVaultSAR
          • Google Drive Last Access Date
          • Nightly Events Processor Job
          • Notifications Processor Job
          • Portal Sync Job
          • Purge Job
          • Text Content Merge Job
        • Output
        • Agents
        • Scheduling
      • Migration Configuration
        • General
        • Filter
        • Metadata Mappings
        • Agents
        • Scheduling
        • Advanced
    • Credentials
    • Mappings
      • Entities
        • Manage Entity Groups
        • Create an Entity
        • Manage an Entity
      • Models
        • Create a New Model
        • Find a Model
        • Enable or Disable a Model
      • Vectors
      • Rank Features
    • Featured Links
    • AI Settings
      • Classifications
      • Class
      • Class Rules
      • AI Classification
    • User Settings
    • Stats
      • Data Views
    • Global Settings
      • General
      • Authentication
      • App Settings
      • Application Access
      • Thumbnails
      • Presets
      • Code of Conduct
      • Metrics
      • Viewer
      • SAR
        • Importing Data For A SAR
        • SAR Disclosure Document Storage
        • Getting SAR data from Google Vault
        • SAR Access
        • SAR File Status
      • Disclosure Portal
        • Disclosure Portal Set Up
        • SARs From The Portal
        • Email Delivery Settings
          • Delivery Settings
          • Brand Settings
          • Customise Emails
        • SMS Delivery Settings
        • Requestor Message Limit
        • Attachment Configuration
        • Password Configuration
        • File Scanner Configurator
      • Collections
      • Visualisations
        • Related Result Connections Diagram
        • Event Timeline
        • Timeline Lens Activity Chart
        • Relationship Map
      • Notifications
      • Map Lens
      • Theming
      • User Avatar
      • OData API
      • Uploads
      • Security
    • Search Settings
      • Search Relevancy
        • Core Settings
        • Makers Algorithm
        • Filename Boost Layer
        • Minimum Matching Terms Filter
        • Field Boost
        • Modified Date Boosting
        • Hit Highlighting
        • Why My Search Matched
        • Data Search Strategy
      • Bulk Search
        • Managing a Bulk Search
      • Search Flows
        • Create a Search Flow
          • General
          • Query Classification Step
          • Search Steps
          • Model Steps
      • Filtering
      • Search Performance
      • Related Results
  • AI Studio
    • Classifications
      • Classifications
      • Classification Rules
    • Jobs
  • Labels
  • API Guides
    • Insight API Guide
      • Swagger Documentation
      • Trying Some Endpoints
      • Search Filter
      • Hits / Items
      • Inspecting REST Calls
    • Data Science API Guide
      • REST Interface
        • Login
        • Datasets
        • Fields
        • Field Statistics
        • Search
        • Scroll
        • Update
      • Python Wrapper
        • Login
        • Datasets
        • Fields
        • Field Statistics
        • Search
        • Query Builders
        • Scroll
        • Scroll Search
        • Update Single Document
        • Bulk Update
    • Creating a Native Enrichment Step
      • Creating an Enrichment Step
        • Creating the Core Classes
        • Extending our Enrichment Step
        • Adding a Configuration Template
        • Adding the Enrichment Step
        • Creating an Enrichment Pipeline
      • Other Tasks
        • Entities, Metadata and Data
        • Accessing the Repository
      • Example Code
      • Troubleshooting
    • Creating a Python Enrichment Step
      • Creating an Enrichment Step
        • Running the Example from Command Line
        • Running the Example
      • Creating Your Own Step
      • Adding or Changing Entities, Metadata
  • Whitepapers and Explainers
    • From a Billion To One – Mastering Relevancy
    • Methods for Text Summarization
      • Application
      • Technology Methods
      • Commercial Tools
      • Key Research Centres
      • Productionisation
      • Related Areas of Text Analytics
      • Conclusion
      • References
Powered by GitBook
On this page
  • Document Recommendations
  • Searchable PDF Storage
  • Versioning
  • Results
  • Marking Useful Results
  • Folder Browsing
  • Cascading Search
  • Search Suggestions
  • Miscellaneous
  1. Control Hub
  2. Global Settings

General

PreviousGlobal SettingsNextAuthentication

Last updated 1 month ago

There are a number of settings that can be configured on the General page of Global Settings.

Document Recommendations

Fine tune what items are returned as document recommendations.

  • Max Query Terms - Enter the maximum number of terms that will be used to find similar results.

    • Increasing this value will give more accurate results but the search will take longer.

  • Minimum Term Frequency - Enter the minimum number of times a term must appear in a result to be used in further recommendation searches.

  • Minimum Document Frequency - Enter the minimum number of items a term must appear in to be used in further recommendation searches.

  • Maximum Document Frequency - Enter a maximum number of items a term can appear in before it is ignored. Eg. 'The', 'And', etc.

  • Score Threshold - Enter a minimum score items must have to be returned as a recommendation.

    • Items are given a score to indicate how similar they are.


Searchable PDF Storage

This must be configured for Searchable PDF's to work. Set up the storage location for searchable PDF files. These are hidden files that are cached for the lifetime of the original file.

  • Searchable PDF Storage Configuration - Select the storage type to use from the dropdown.

    • Choose between AzureStorage, FileSystemStorage, GoogleStorage.

Azure Storage
  1. Endpoint Suffix - Enter the Endpoint Suffix for the storage account.

  2. Account Name - Enter the name linked to the storage account.

  3. Access Key Type - Select either Account or SAS from the dropdown.

  4. Credential - Choose the credential for this storage from the dropdown.

  5. Root Azure Container ID - Enter the Root Azure Container ID for this storage.

File System Storage
  1. Store Root - Enter the root folder of this File System Storage.

  2. Reserved Disk Space - Choose the Reserved Disk Space for this storage in bytes.

  3. Error On Full Storage - Check this to get notified if this gets full.

Google Storage
  1. Project ID - Enter the Project ID from the Google Cloud Platform.

  2. Bucket Location - Enter the Bucket Location from the Google Cloud Platform.

  3. Bucket Prefix - Enter the prefix that's added to the beginning of all buckets.


Versioning

Some source types allowing users to search for older versions of data with Versioning. Check Versioning to enable this feature.


Results

  1. File Sizes - Check File Sizes Enabled to show data and document sizes within the results view.

    • For sources with lots of data or web pages this can be irrelevant and use more memory.

  2. Mark as Sensitive - Check Mark as Sensitive to allow users to mark results and apply a sensitive status.

    • Depending on the status of a document they may or may not be visible in future searches.

  3. Missing Information Fields - Check Show Missing Information Fields to show missing information within a data table.

  4. Result Sources Tab - Uncheck Result Sources Tab to disable the result sources tab shown within Search.

    • By default this feature is on.


Marking Useful Results

This allows users to mark data or documents as useful. This indicates to other users who found what items useful. You can personalise the use case of this feature to fit your business needs.

  1. Enabled - Check this to turn on this feature.

  2. Select Component Icon - Select the icon you want to signify this action from the dropdown.


Folder Browsing

Folder Browsing allows users to navigate data by browsing subfolders. Users can share information and add items to collections or SARs from here too.

  • Enabled - Check this to enable users to browse hierarchical data and document stores in a Windows Explorer style interface.


Cascading Search

This allows users to create custom searches. They can add entities surfaced as part of a search to an existing search query or to a new one. They can build up a search progressively by finding new entities or create a new one based off entities surfaced.

  • Enabled - Check enabled to allow users to create cascading searches.


Search Suggestions

Show users suggested searches as they browse. Search suggestions use Elasticsearch to generate suggestions during the indexing process.

  1. Enabled - Check this to enable search suggestions for users.

  2. Number of Shingles - Choose the number of shingles that are created from a search to create suggestions.


Miscellaneous

  1. Maximum Text Content Size - Enter a Maximum Text Content Size for indexed content in bytes to limit the size of a text based file.

  2. Entity Groups Hidden From Document Details - Add entity groups to hide them from all documents details.

    • By default PCI and PII entity groups are hidden, you can add to or remove these groups.

  3. Enable Permissions for Entities, Metadata and Attributes - Check this to hide protected attributes from users who don't have access.

  4. Show Matching Contact List - Check this to show contacts who match a search within the results.

  5. Respect Newline Characters in Data Item Hits - Check this to respect new lines within hit highlights displayed in an item.

You need to configure a source to allow versioned documents for this to work. .

See our guide for Versioned Document Store to help set up versioning