Skip to content

Support timeouts in send_request #2138

Description

@vdusek

SendRequestFunction (src/crawlee/_types.py) takes only url, method, payload and headers, so a request handler cannot bound how long an extra HTTP call may take. Add a timeout option.

JS implementation: apify/crawlee#3457

✍️ Drafted by Claude Code

Activity

  1. added
    enhancementNew feature or request.
    t-toolingIssues with this label are in the ownership of the tooling team.
    on Aug 7, 2026
  2. added this to the 2.0 milestone on Aug 7, 2026
  3. Battleplus commented on Aug 13, 2026

    @Battleplus

    Hi, I'd like to work on this issue.

    I plan to add the timeout option to the public SendRequestFunction contract, pass it through the crawler context helper to the existing HTTP client timeout support, and add focused regression tests. I will keep the change scoped to #2138 and account for the open HTTP-client cookie/connection-pool work when reviewing conflicts.

    OpenAI Codex will assist with implementation, test design, and review. I will inspect, understand, and verify the changes before submitting the PR.

  4. added a commit that references this issue on Aug 25, 2026
    c2013a0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request.t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions