- Source: where source documents are retrieved from
- Destination: where the Agent’s output is sent
Configuring Integrations
Integrations can be configured for each Agent either using the “Integrations” tab or by using the Agent overview on the main Agent page.
How Integrations Work
Sources
If a file storage system is used as a Source (e.g. Box, Google Drive, S3), the Agent will automatically watch the Source for new files. When new files are detected, the Agent will create new Runs to process those files. See Cloud Folder Sync for details on how folders are kept in sync. Sources can be configured to read files in two different patterns:- Import Files Separately: Each file in a source location is processed as a separate Run.
- Group Files Together: All files in a sub-folder pattern are processed together, where each sub-folder’s content as a single run by the Agent.
Destinations
If a file storage system is used as a Destination (e.g. Box, Google Drive, S3), the Agent will write output files to the Destination after each Run is completed. Destinations can be configured to write files in two different patterns:- Write to Directory: Each Run by the Agent produces output files sent to the Destination.
- Write to File: Each Run by the Agent produces a row in a single output spreadsheet.
You can export your results to a destination as PDF, Word, Excel, CSV, JSON, or Powerpoints.
You can also use templates to customize the format of your output files.
Example Workflows
These patterns can be combined. Let’s consider how to model some example workflows:FAQ
I’ve set up a Source Integration, when will my Agent start processing files?
Files already in the Source are imported when the Integration is added, and new files are typically detected within a minute or two of being added. For Sources that group files together, Kolena waits until a sub-folder has been quiet for 5 minutes before processing it, so it may take up to five minutes before new runs are created. When connecting a folder that already contains a large number of files, the initial import happens in batches and may take some time to complete. See Cloud Folder Sync for details.How many Integrations can I add to my Agent?
Multiple Source and Destination Integrations can be added to a single Agent.What happens if I add a new file to a Source?
For Sources where files are imported separately:- If a new file is added, Kolena will create a new run for that file
- If a new file is added to a sub-folder, Kolena will create a new run if one does not exist or update an existing run if one already exists for that grouping.
