Index Node Documentation
The Index node inserts records into a vector database, enabling fast semantic retrieval. This node is part of a larger workflow that allows users to manage and configure the indexing of data, including vectors and metadata, into a specified vector database. By configuring various parameters such as the vector database, metadata fields, and embedding models, users can tailor the indexing process to their specific needs.
Features
Key Functionalities
-
Custom Logic Integration: Seamlessly incorporate JavaScript code to create tailored workflows.
-
Data Manipulation: Process and transform large datasets dynamically within your flows.
-
Third-Party API Support: Extend your workflows by connecting to external APIs and services.
-
Dynamic Report Generation: Automate the creation of insightful reports based on real-time data.
-
Testing and Deployment Tools: Easily test and deploy JavaScript logic directly in the Lamatic platform.
Benefits
-
Enhanced Flow Customization: Tailor flows to meet specific business or operational needs.
-
Streamlined Automation: Minimize manual intervention with robust, automated processes.
-
Improved Efficiency: Optimize workflows by integrating complex operations directly into your flows.
-
Reduced Development Overhead: Empower developers to build and deploy custom logic without external systems.
-
Scalable Design: Create reusable logic components that adapt to various use cases and scale with your needs.
What Can You Build?
- Develop a system for efficient document retrieval based on semantic content.
- Build a recommendation engine that suggests content based on vector similarity.
- Create a search interface that allows users to find related articles or documents quickly.
- Implement a data analysis tool that organizes and retrieves large datasets using vector embedding.
Setup
Select the Index Node
- Fill in the required parameters.
- Build the desired flow
- Deploy the Project
- Click Setup on the workflow editor to get the automatically generated instruction and add it in your application.
Configuration Reference
Parameter | Description | Required | Example Value |
---|---|---|---|
Vector DB | Select the vector database where the vectors will be indexed. | Yes | database |
Vectors | Enter the vector data to be indexed in the database. | Yes | {{codeNode_540.output.vectors}} |
Metadata | Include additional information to enhance vector search and retrieval. | Yes | {{codeNode_540.output.vectors}} |
Primary Keys (JSON) | Provide unique identifiers for each vector in JSON format. | Yes | [] |
Duplication Records | Manage duplicates by choosing to overwrite or skip them. | No | overwrite |
Low-Code Example
- nodeId: IndexNode_543
nodeType: IndexNode
nodeName: Index to DB
values:
vectorDB: IndexCrawler
webhookURL: https://webhook.site/685a66e7-b4d3-40a4-9801-99e3460414f9
primaryKeys: ''
vectorsField: '{{codeNode_540.output.vectors}}'
metadataField: '{{codeNode_540.output.metadata}}'
duplicateOperation: overwrite
embeddingModelName: {}
generativeModelName:
type: embedder/text
nodeId: IndexNode
model_name: text-embedding-ada-002
provider_name: openai
needs:
- codeNode_540
Troubleshooting
Common Issues
Problem | Solution |
---|---|
Invalid Database | Ensure the database is correct. |
Dynamic Content Not Loaded | Increase the Wait for Page Load time in the configuration. |
Debugging
- Check Lamatic Flow logs for error details.