ScrapegraphAI icon

ScrapegraphAI

Consume ScrapegraphAI API

Actions3

Overview

This node integrates with the ScrapegraphAI API to convert website content into markdown format. Specifically, the "Markdownify" resource with the "Convert" operation takes a URL of a website and returns its content transformed into markdown syntax.

This is useful for scenarios where you want to extract clean, readable markdown from web pages for documentation, note-taking, or content migration purposes. For example, you could convert blog posts, articles, or product pages into markdown to store in a knowledge base or static site generator.

Properties

Name Meaning
Website URL The URL of the website to convert to markdown

Output

The output is a JSON object containing the response from the ScrapegraphAI API's markdownify endpoint. This typically includes the markdown-formatted content extracted from the specified website URL.

The exact structure depends on the API response but generally will have fields representing the markdown text and possibly metadata about the conversion.

No binary data output is indicated by the code.

Dependencies

  • Requires an active connection to the ScrapegraphAI API.
  • Needs an API key credential for authentication with the ScrapegraphAI service.
  • The node makes HTTP POST requests to https://api.scrapegraphai.com/v1/markdownify.

Troubleshooting

  • Common issues:

    • Invalid or missing API key will cause authentication failures.
    • Providing an invalid or unreachable website URL may result in errors or empty markdown output.
    • Network connectivity problems can prevent successful API calls.
  • Error messages:

    • Errors returned from the API are caught and can be output as error messages if "Continue On Fail" is enabled.
    • Typical error messages might include authentication errors, rate limiting notices, or invalid input errors.
  • Resolutions:

    • Ensure the API key credential is correctly configured and valid.
    • Verify the website URL is correct and accessible.
    • Check network connectivity and firewall settings.
    • Enable "Continue On Fail" to handle errors gracefully within workflows.

Links and References

Discussion