Skip to content

feat: add wait_ms parameter to SmartScraper, Scrape, and Markdownify#78

Merged
VinciGit00 merged 2 commits intomainfrom
feat/add-wait-ms-parameter
Feb 13, 2026
Merged

feat: add wait_ms parameter to SmartScraper, Scrape, and Markdownify#78
VinciGit00 merged 2 commits intomainfrom
feat/add-wait-ms-parameter

Conversation

@VinciGit00
Copy link
Member

Summary

  • Adds a new optional wait_ms parameter to SmartScraper, Scrape, and Markdownify endpoints (models, sync client, and async client)
  • The parameter controls how many milliseconds to wait before scraping the website (API default is 3000ms)
  • Aligns the Python SDK with the API change in ScrapeGraphAI/sgai-api#399

Changes

  • Models: Added wait_ms: Optional[int] field to SmartScraperRequest, ScrapeRequest, and MarkdownifyRequest
  • Sync Client: Added wait_ms parameter to smartscraper(), scrape(), and markdownify() methods
  • Async Client: Added wait_ms parameter to smartscraper(), scrape(), and markdownify() methods
  • Tests: Added tests for default value, custom value, and serialization behavior

Test plan

  • All new wait_ms model tests pass (8 tests)
  • Existing model tests unaffected
  • Verify integration with API once ScrapeGraphAI/sgai-api#399 is merged

🤖 Generated with Claude Code

…endpoints

Adds a new optional wait_ms parameter that controls how long to wait
before scraping the website. This aligns the SDK with the API change
in ScrapeGraphAI/sgai-api#399.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@github-actions
Copy link

github-actions bot commented Feb 13, 2026

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

VinciGit00 added a commit to ScrapeGraphAI/docs-mintlify that referenced this pull request Feb 13, 2026
Documents the new wait_ms parameter added to SmartScraper, Scrape, and
Markdownify endpoints, covering Python SDK, JavaScript SDK, and cURL usage.

Relates to:
- ScrapeGraphAI/sgai-api#399
- ScrapeGraphAI/scrapegraph-py#78
- ScrapeGraphAI/scrapegraph-js#5

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
The trailing comma turned the Field assignment into a tuple, breaking
model_dump() serialization (headers always present even when None).

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@VinciGit00 VinciGit00 merged commit 580b8ba into main Feb 13, 2026
5 of 9 checks passed
@VinciGit00 VinciGit00 deleted the feat/add-wait-ms-parameter branch February 13, 2026 17:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants