Skip to content

Latest commit

 

History

History
100 lines (78 loc) · 3.2 KB

introduction.mdx

File metadata and controls

100 lines (78 loc) · 3.2 KB
title description
Introduction
Welcome to ScrapeGraphAI - AI-Powered Web Data Extraction

<img style={{ borderRadius: '0.5rem' }} src="/images/introduction/docs-banner.png" />

Overview

ScrapeGraphAI is a powerful suite of LLM-driven web scraping tools designed to extract structured data from any website and HTML content. Our API is designed to be easy to use and integrate with your existing workflows.

Perfect For

Feed your AI agents with structured web data for enhanced decision-making Extract and structure web data for research and analysis Build comprehensive datasets from web sources Create scraping-powered platforms and applications

Getting Started

Sign up and access your API key from the [dashboard](https://dashboard.scrapegraphai.com) Select from our specialized extraction services based on your needs Begin extracting data using our SDKs or direct API calls

Documentation Structure

Learn how to manage your account, monitor jobs, and access your API keys Explore our core services: SmartScraper, SearchScraper, and Markdownify Implement with Python, JavaScript, or integrate with LangChain and LlamaIndex Detailed API documentation for direct integration

Core Services

  • SmartScraper: AI-powered extraction for any webpage
  • SearchScraper: Find and extract any data using AI starting from a prompt
  • Markdownify: Convert web content to clean Markdown format

Implementation Options

Official SDKs

  • Production-ready SDKs for Python and JavaScript
  • Comprehensive error handling and retry logic
  • Type hints and full IDE support

Integrations

  • Seamless integration with LangChain
  • Native support for LlamaIndex
  • Perfect for AI agent workflows

Examples & Use Cases

Visit our Cookbook to explore real-world examples and implementation patterns:

  • E-commerce data extraction
  • News article scraping
  • Research data collection
  • Content aggregation
ScrapeGraphAI is built with transparency in mind. Check out our open-source core at: [github.com/scrapegraphai/scrapegraph-ai](https://github.com/scrapegraphai/scrapegraph-ai) Get your API key and start extracting data in minutes!