Skip to content

Latest commit

 

History

History
98 lines (71 loc) · 3.22 KB

CHANGELOG.md

File metadata and controls

98 lines (71 loc) · 3.22 KB

Changelog

[1.2.4] - 2024-02-05

Added

  • Environment variable support for all configuration options
  • Detailed configuration documentation in README

Changed

  • Made retry and credit monitoring settings configurable via environment variables:
    • FIRECRAWL_RETRY_MAX_ATTEMPTS
    • FIRECRAWL_RETRY_INITIAL_DELAY
    • FIRECRAWL_RETRY_MAX_DELAY
    • FIRECRAWL_RETRY_BACKOFF_FACTOR
    • FIRECRAWL_CREDIT_WARNING_THRESHOLD
    • FIRECRAWL_CREDIT_CRITICAL_THRESHOLD
  • Enhanced configuration examples with detailed comments and use cases
  • Improved documentation for retry behavior and credit monitoring

Documentation

  • Added comprehensive configuration examples for both cloud and self-hosted setups
  • Added detailed explanations of retry behavior with timing examples
  • Added credit monitoring threshold explanations
  • Updated Claude Desktop configuration documentation

[1.2.3] - 2024-02-05

Changed

  • Removed redundant batch configuration to rely on FireCrawl library's built-in functionality
  • Simplified batch processing logic by leveraging library's native implementation
  • Optimized parallel processing and rate limiting handling
  • Reduced code complexity and potential configuration conflicts

Technical

  • Removed custom CONFIG.batch settings (maxParallelOperations and delayBetweenRequests)
  • Simplified batch operation processing to use library's built-in batch handling
  • Updated server startup logging to remove batch configuration references
  • Maintained credit usage tracking and error handling functionality

[1.2.2] - 2025-02-05

Fixed

  • Resolved unused interface warnings for ExtractParams and ExtractResponse
  • Improved type safety in extract operations
  • Fixed type casting issues in API responses

Changed

  • Improved type guards for better type inference
  • Enhanced error messages for configuration validation

[1.2.0] - 2024-01-03

Added

  • Implemented automatic retries with exponential backoff for rate limits
  • Added queue system for batch operations with parallel processing
  • Integrated credit usage monitoring with warning thresholds
  • Enhanced content validation with configurable criteria
  • Added comprehensive logging system for operations and errors
  • New search tool (firecrawl_search) for web search with content extraction
  • Support for self-hosted FireCrawl instances via optional API URL configuration
    • New FIRECRAWL_API_URL environment variable
    • Automatic fallback to cloud API
    • Improved error messages for self-hosted instances

Changed

  • Improved error handling for HTTP errors including 404s
  • Enhanced URL validation before scraping
  • Updated configuration with new retry and batch processing options
  • Optimized rate limiting with automatic backoff strategy
  • Improved documentation with new features and examples
  • Added detailed self-hosted configuration guide

Fixed

  • Rate limit handling in batch operations
  • Error response formatting
  • Type definitions for response handlers
  • Test suite mock responses
  • Error handling for invalid search queries
  • API configuration validation

[1.0.1] - 2023-12-03

Added

  • Initial release with basic scraping functionality
  • Support for batch scraping
  • URL discovery and crawling capabilities
  • Rate limiting implementation