Extract from File Node Documentation

The Extract from File node is designed to parse and extract data from multiple file formats. It provides a flexible interface for handling different file types with customizable configuration options, ensuring accurate data extraction and formatting for downstream processing.

Features

What can I build?

1. Data processing pipelines that handle multiple file formats
2. Automated document parsing systems
3. Data extraction flow for business intelligence
4. Content aggregation systems from various file sources
5. Extract data from files as base64 and use it in AI nodes

Setup

Select the Extract from File Node

1. Choose the appropriate operation for your file type
2. Configure format-specific parameters
3. Provide the file URL
4. Deploy and test the extraction

Configuration Reference

Common Parameters

Format-Specific Parameters

Sample Input

   File URL(s): ["https://calibre-ebook.com/downloads/demos/demo.docx","https://example-files.online-convert.com/document/txt/example.txt","https://sedl.org/afterschool/toolkits/science/pdf/ast_sci_data_tables_sample.pdf"]
   Format: Auto Detect
   Everything Else Default

Low-Code Example

nodes:
  - nodeId: extractFromFileNode_983
    nodeType: extractFromFileNode
    nodeName: Extract from File
    values:
      trim: false
      ltrim: false
      quote: '"'
      rtrim: false
      comment: "null"
      fileUrl: >-
        ["https://calibre-ebook.com/downloads/demos/demo.docx","https://example-files.online-convert.com/document/txt/example.txt","https://sedl.org/afterschool/toolkits/science/pdf/ast_sci_data_tables_sample.pdf"]
      headers: true
      maxRows: "0"
      encoding: utf8
      maxPages: "0"
      password: ""
      skipRows: "0"
      delimiter: ","
      joinPages: true
      format: auto
      skipLines: "0"
      ignoreEmpty: false
      returnRawText: false
      discardUnmappedColumns: false
    needs:
      - triggerNode_1

Output

files

• An array of objects, each representing a file and its extracted content along with associated metadata.

metadata

• A nested object containing descriptive attributes of the file.

  • mime_type: Specifies the file’s MIME type, indicating its format and encoding.
  • type: Categorizes the file’s general type.
  • filename: The name of the file.
  • extension: The file’s extension.
  • url: The source URL of the file.
  • size: The file size in bytes, or null if not available.
  • file_id: A unique identifier for the file within the processing context.

data

• An array of strings containing the extracted content from the file.

additional_fields

• A nested object containing supplementary data or metadata about file processing.

raw

• An array of objects providing unprocessed or detailed extraction data.

  • metadata: A nested object within raw detailing file format and creation metadata.
    • format: The file’s format version.
    • title: The file’s title.
    • author: The file’s author.
    • subject: A description of the file’s subject.
    • keywords: Keywords associated with the file.
    • creator: The software or tool used to create the file.
    • producer: The software or library that produced the file.
    • creationDate: The file’s creation date.
    • modDate: The file’s last modification date.
    • trapped: Related to PDF trapping status.
    • encryption: Indicates the file’s encryption status, or null if not encrypted.

file_path

• A string specifying the temporary or local file path used during processing.

page_count

• An integer indicating the total number of pages in the file.

page

• An integer specifying the page number of the extracted content.

toc_items

• An array containing the table of contents items.

tables

• An array of objects describing tables extracted from the file.

  • bbox: An array of coordinates defining the bounding box of a table.
  • rows: The number of rows in a table.
  • columns: The number of columns in a table.

images

• An array of image data extracted from the file.

graphics

• An array of graphic elements extracted from the file.

text

• A string containing the raw text content extracted from a specific page or section.

words

• An array of individual words extracted from the text.

Example Output

"files": [
      {
        "metadata": {
          "mime_type": "application/vnd.openxmlformats-officedocument.wordprocessingml.document",
          "type": "document",
          "filename": "demo.docx",
          "extension": "docx",
          "url": "https://calibre-ebook.com/downloads/demos/demo.docx",
          "size": 1311881,
          "file_id": 0
        },
        "data": [
          "data"
        ]
      },
      {
        "metadata": {
          "file_id": 1,
          "type": "document",
          "url": "https://example-files.online-convert.com/document/txt/example.txt",
          "filename": "example.txt",
          "extension": "txt",
          "mime_type": "text/plain; charset=UTF-8",
          "size": null
        },
        "data": [
          "data"
        ]
      }
    ]

Troubleshooting

Common Issues

Debugging

1. Check file accessibility
2. Verify file format matches operation
3. Review format-specific configuration
4. Check node logs for detailed error messages