Web Search Node

Overview

The Web Search Node is a web data access component that enables powerful web scraping and search capabilities through serper.dev (opens in a new tab). This node supports multiple search types including web search, news search, and direct webpage scraping, with customizable filters and structured result retrieval for comprehensive web data access and analysis.

This node is an Action node that provides comprehensive web data access and analysis through multiple search types and advanced filtering capabilities.

Features

Prerequisites

Before using Web Search Node, ensure the following:

• Serper API Key: Valid API key from serper.dev (opens in a new tab) for authentication.
• Web Search Credentials: Web Search credentials configured in Lamatic with proper API access.
• Search Parameters Understanding: Understanding of search parameters and filtering options.
• API Usage Awareness: Proper awareness of API usage limits and rate limiting requirements.

Installation

Step 1: Get Serper API Key

1. Sign Up: Create an account at serper.dev (opens in a new tab)
2. Generate API Key: Navigate to the API key section in your dashboard
3. Copy Key: Save your API key securely for configuration

Step 2: Configure Web Search Credentials

Use the following format to set up your credentials:

Step 3: Set Up Lamatic Flow

1. Add Web Search Node: Drag the Web Search node to your flow
2. Enter Credentials: Provide your Serper API key
3. Configure Search Parameters: Set up search type, filters, and preferences
4. Test Connection: Verify the credentials work properly

Configuration Reference

Action Node Configuration

Search Types

Date Range Options

Language Options

Low-Code Example

nodes:
  - nodeId: webSearchNode_788
    nodeType: webSearchNode
    nodeName: Web Search
    values:
      credentials: Serper Basic Auth
      query: test
      type: https://google.serper.dev/search
      dateRange: ""
      results: 10
      page: 1
      country: in
      language: hi
      location: ""
    needs:
      - triggerNode_1

Event Trigger Output

The Web Search node outputs search results in the following format:

Example Output

{
    "searchParameters": {
        "q": "best restaurants in new york",
        "type": "search",
        "num": 10,
        "page": 1,
        "country": "US",
        "language": "en"
    },
    "organic": [
        {
            "position": 1,
            "title": "Best Restaurants in New York City",
            "link": "https://example.com/restaurants",
            "displayed_link": "example.com/restaurants",
            "snippet": "Discover the top restaurants in NYC...",
            "sitelinks": []
        }
    ],
    "knowledgeGraph": {
        "title": "New York City",
        "type": "City",
        "description": "New York City is the most populous city..."
    },
    "relatedSearches": [
        {
            "query": "best pizza in new york",
            "displayQuery": "best pizza in new york"
        }
    ]
}

Output Schema

• searchParameters: Object containing the search parameters used
• organic: Array of organic search results
  • position: Integer ranking position
  • title: String title of the result
  • link: String URL of the result
  • displayed_link: String display URL
  • snippet: String description snippet
• knowledgeGraph: Object containing knowledge graph information (if available)
• relatedSearches: Array of related search suggestions

Output Schema

Action Node Output

• searchParameters: Object containing search configuration
  • q: String search query
  • type: String search type
  • num: Integer number of results
  • page: Integer page number
  • country: String country code
  • language: String language code
• organic: Array of search results
  • position: Integer result position
  • title: String result title
  • link: String result URL
  • displayed_link: String display URL
  • snippet: String result description
• knowledgeGraph: Object with knowledge graph data (optional)
• relatedSearches: Array of related search queries (optional)
• news: Array of news results (for news searches)
• places: Array of place results (for location searches)

Usage Examples

Basic Web Search

# Basic web search configuration
nodes:
  - nodeId: webSearchNode_1
    nodeType: webSearchNode
    nodeName: Web Search
    values:
      credentials: Serper Basic Auth
      query: "artificial intelligence trends 2024"
      type: "Search"
      results: 10
      page: 1
    needs:
      - triggerNode_1

News Search with Filters

# News search with date and location filters
nodes:
  - nodeId: webSearchNode_2
    nodeType: webSearchNode
    nodeName: News Search
    values:
      credentials: Serper Basic Auth
      query: "tech industry news"
      type: "News"
      dateRange: "Last 24 Hours"
      results: 5
      country: "US"
      language: "en"
    needs:
      - triggerNode_1

Webpage Scraping

# Direct webpage content extraction
nodes:
  - nodeId: webSearchNode_3
    nodeType: webSearchNode
    nodeName: Webpage Scrape
    values:
      credentials: Serper Basic Auth
      query: "https://example.com/article"
      type: "WebPage"
    needs:
      - triggerNode_1

Troubleshooting

Common Issues

Debugging

• Review Lamatic Flow logs for detailed error messages
• Verify API key status and usage in serper.dev dashboard
• Test search parameters individually to isolate issues
• Check network connectivity and API endpoint accessibility
• Monitor API usage and respect rate limiting
• Use simple queries first, then add complexity
• Verify country and language codes are correct
• Test with different search types to identify type-specific issues

Best Practices

• Use specific, targeted search queries for better results
• Implement proper error handling for API failures
• Monitor API usage to stay within rate limits
• Use appropriate date ranges to filter relevant content
• Test search parameters in development before production
• Implement result caching for frequently searched queries
• Use geographic targeting for location-specific searches
• Regularly verify API key validity and permissions

Example Use Cases

Research and Analysis

• Market Research: Search for industry trends and competitor information
• Content Research: Gather information for content creation and analysis
• Academic Research: Collect data for research papers and studies
• News Monitoring: Track current events and trending topics

Business Intelligence

• Competitive Analysis: Monitor competitor activities and strategies
• Market Trends: Track industry developments and market changes
• Customer Insights: Research customer preferences and behaviors
• Product Research: Gather information about products and services

Content Creation

• Article Research: Collect information for blog posts and articles
• Fact Checking: Verify information and gather supporting data
• Trend Analysis: Identify trending topics and popular content
• Source Verification: Find and verify information sources

Additional Resources

• Serper API Documentation (opens in a new tab)
• Serper Dashboard (opens in a new tab)
• API Key Management (opens in a new tab)
• Search Parameters Guide (opens in a new tab)