Valyu icon

Valyu

Valyu Deepsearch & Contents

Overview

This node integrates with the Valyu API to perform content extraction and summarization from web URLs. Specifically, the "Contents (Extract/Summarize)" operation allows users to input up to 10 URLs and retrieve summarized or extracted content from those pages. The node supports different summary modes including no AI processing, basic AI-generated summaries, custom prompt-based summaries, and structured summaries based on a JSON schema.

Common scenarios where this node is beneficial include:

  • Quickly extracting key information from multiple web pages for research or monitoring.
  • Generating concise summaries of articles or reports without manual reading.
  • Structuring extracted data into a predefined format for further automated processing.
  • Customizing summaries using user-defined prompts to tailor output to specific needs.

Practical example: A user inputs URLs of recent news articles and requests a medium-length, AI-generated summary for each. The node returns an array of summarized contents that can be used in reports or dashboards.

Properties

Name Meaning
URLs (Comma/Newline Separated, Up to 10) List of URLs (up to 10) from which to extract and summarize content.
Response Length Controls the length/detail level of the response. Options: Short, Medium, Large, Max.
Summary Mode Determines how the summary is generated: No AI, Basic AI Summary, Custom Prompt (string), Structured (JSON Schema).
Custom Prompt A user-defined text prompt to customize the summary generation (used only if Summary Mode is "Custom Prompt").
JSON Schema (as JSON) A JSON schema defining the structure for the summary output (used only if Summary Mode is "Structured").
Extract Effort Level of effort for content extraction: Normal or High. Higher effort may yield more detailed extraction.
Return Defines what is returned by the node: either just the results array or the full API response object.

Output

The node outputs a JSON array where each element corresponds to the processed content from one of the input URLs. The exact structure depends on the summary mode:

  • If no AI summary is requested, raw extracted content is returned.
  • For basic or custom prompt summaries, the output contains summarized text.
  • For structured summaries, the output follows the user-provided JSON schema.

If the "Return" property is set to "Full API Response," the entire response from the Valyu API is returned instead of just the results array.

The node does not output binary data.

Dependencies

  • Requires an API key credential for the Valyu API.
  • The node makes authenticated HTTP POST requests to the Valyu API endpoints.
  • The base URL for the API is obtained from the configured credentials.
  • No additional environment variables are required beyond the API authentication.

Troubleshooting

  • Common issues:

    • Invalid or missing API credentials will cause authentication errors.
    • Providing more than 10 URLs will likely result in an error or truncated processing.
    • Malformed URLs or unreachable URLs may cause request failures or empty results.
    • Incorrect JSON schema in "Structured" summary mode can lead to API validation errors.
  • Error messages:

    • Authentication errors: Check that the API key credential is correctly configured and valid.
    • Validation errors from the API: Verify that all required properties are provided and correctly formatted.
    • Network errors: Ensure the node has internet access and the Valyu API endpoint is reachable.

Links and References

Discussion