Skip to content

build(deps): bump w3lib from 2.5.0 to 2.6.0 - #272

Closed
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/w3lib-2.6.0
Closed

dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/w3lib-2.6.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Bumps w3lib from 2.5.0 to 2.6.0.

Changelog

Sourced from w3lib's changelog.

2.6.0 (2026-11-05)

Backwards incompatible changes:

  • Dropped support for Python 3.10 (#368) and PyPy (#392).

  • w3lib now depends on frostwork <https://github.com/scrapy/frostwork>__, which it uses to detect encodings and to read the base URL and meta refresh of HTML documents the way browsers do (#392).

  • :func:~w3lib.encoding.html_to_unicode now detects the encoding of a body that has no BOM and declares no encoding the way Firefox does: as UTF-8 if the body is valid UTF-8, and otherwise guessed from its bytes and from the top-level domain of the new url parameter, instead of assuming UTF-8. UTF-8 is now reported as utf-8 instead of utf8 (#392).

  • Encoding labels now resolve to the encodings of the Encoding Standard_, decoded the way browsers decode them, in :func:~w3lib.encoding.html_to_unicode, :func:~w3lib.encoding.html_body_declared_encoding, :func:~w3lib.encoding.resolve_encoding, :func:~w3lib.encoding.read_bom and :func:~w3lib.encoding.to_unicode (#392). In particular:

    • UTF-32 is no longer supported: :func:~w3lib.encoding.resolve_encoding returns None for it, and a UTF-32LE BOM reads as a UTF-16LE one.

    • utf-16 without a BOM is now little-endian, and a utf-16 label declared in the body now means UTF-8.

    • gb2312 and gbk now resolve to gbk instead of gb18030.

    • x-user-defined and replacement are new possible encoding names, for which importing :mod:w3lib.encoding registers Python codecs.

  • :func:~w3lib.encoding.html_body_declared_encoding now follows the HTML prescan: it no longer stops at the <body> tag, and it no longer honors misspelled http-equiv pragmas, such as httpequiv="ContentType", or a < followed by whitespace before meta (#392).

  • With an absolute baseurl, :func:~w3lib.html.get_meta_refresh now returns the meta refresh that a browser follows (#392):

    • The URL is resolved against the <base> element of the document, and its query is encoded as UTF-8.

    • A refresh without a URL now reloads the document, i.e. returns baseurl, instead of returning (None, None).

    • The fraction of the interval is dropped, e.g. 0.5 is 0.0.

... (truncated)

Commits
  • 65b7cdf Bump version: 2.5.0 → 2.6.0
  • 471d28f Add release notes for 2.6.0 (#418)
  • 4f0bb15 Frostwork integration, PyPy drop (#392)
  • 95071f4 Merge pull request #397 from uchiha-bug-hunter/base-meta-tag-name-end
  • 93fbf95 Merge pull request #404 from uchiha-bug-hunter/tag-name-html-whitespace
  • 26263b0 Merge pull request #412 from EduardOkhotnikov/fix-is-url-scheme
  • 33c3889 avoid the is_url benchmark regression
  • 243c70a accept uppercase schemes and require :// in is_url
  • b9d6f65 Merge pull request #410 from scrapy/dependabot/github_actions/github-actions-...
  • 4319709 Bump the github-actions group with 4 updates
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [w3lib](https://github.com/scrapy/w3lib) from 2.5.0 to 2.6.0.
- [Release notes](https://github.com/scrapy/w3lib/releases)
- [Changelog](https://github.com/scrapy/w3lib/blob/master/NEWS)
- [Commits](scrapy/w3lib@v2.5.0...v2.6.0)

---
updated-dependencies:
- dependency-name: w3lib
  dependency-version: 2.6.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Nov 9, 2026
@dependabot @github

dependabot Bot commented on behalf of github Nov 9, 2026

Copy link
Copy Markdown
Contributor Author

Looks like w3lib is up-to-date now, so this is no longer needed.

@dependabot dependabot Bot closed this Nov 9, 2026
@dependabot
dependabot Bot deleted the dependabot/pip/w3lib-2.6.0 branch November 9, 2026 14:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update Python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants