Code

Make safe_url_string safer#201

Code

Closed

Gallaecio wants to merge 27 commits intoscrapy:masterscrapy/w3lib:masterfrom Gallaecio:safer-urlGallaecio/w3lib:safer-urlCopy head branch name to clipboard

+20,532-289

Commits

Commits on Nov 3, 2022

• test_safe_url_idna: adjust test data to the test scope

  Gallaecio

  committed
  4798aaf

  Copy full SHA for 4798aaf

Commits on Nov 4, 2022

• Fix pytest-cov warning

  Gallaecio

  committed
  86711dd

  Copy full SHA for 86711dd

Commits on Nov 8, 2022

• Implement safe_url and provide partial test coverage

  Gallaecio

  committed
  030a996

  Copy full SHA for 030a996

• Merge remote-tracking branch 'upstream/master' into safer-url

  Gallaecio

  committed
  6f0dc16

  Copy full SHA for 6f0dc16

• Progress on typing

  Gallaecio

  committed
  17ee8d6

  Copy full SHA for 17ee8d6

Commits on Nov 9, 2022

• Address typing issues

  Gallaecio

  committed
  aef0532

  Copy full SHA for aef0532

• Fix unicode encoding in userinfo and IPv6 parsing

  Gallaecio

  committed
  abe4032

  Copy full SHA for abe4032

Commits on Nov 11, 2022

• Progress on tests

  Gallaecio

  committed
  86435df

  Copy full SHA for 86435df

Commits on Nov 15, 2022

• Address issues reported by tests and static checkers

  Gallaecio

  committed
  79193bf

  Copy full SHA for 79193bf

• Complete test coverage for safe_url

  Gallaecio

  committed
  82f6e66

  Copy full SHA for 82f6e66

• Progress on passing upstream tests

  Gallaecio

  committed
  81fc830

  Copy full SHA for 81fc830

Commits on Nov 16, 2022

• Solve issues previously marked as expected failures

  Gallaecio

  committed
  7e72474

  Copy full SHA for 7e72474

• Validate host parsing according to upstream URL living standard tests

  Gallaecio

  committed
  2c62859

  Copy full SHA for 2c62859

Commits on Nov 17, 2022

• Cover port and path in upstream tests

  Gallaecio

  committed
  3623c35

  Copy full SHA for 3623c35

• Cover query and fragment in upstream tests

  Gallaecio

  committed
  2513ea1

  Copy full SHA for 2513ea1

• Add upstream tests for domain_to_ascii

  Gallaecio

  committed
  7d92740

  Copy full SHA for 7d92740

• Add upstream tests for percent encoding

  Gallaecio

  committed
  6a080da

  Copy full SHA for 6a080da

• Add a performance test

  Gallaecio

  committed
  79eafeb

  Copy full SHA for 79eafeb

• Add idna.txt to source distribution

  Gallaecio

  committed
  3028165

  Copy full SHA for 3028165

• 2x speed-up at the cost of mishandling invalid code points

  Gallaecio

  committed
  091905e

  Copy full SHA for 091905e

• _percent_encode_after_encoding: 0.2 speed-up

  Gallaecio

  committed
  fea33a6

  Copy full SHA for fea33a6

• 0.1 speed-up

  Gallaecio

  committed
  184e5a7

  Copy full SHA for 184e5a7

• x1.2 speed up

  Gallaecio

  committed
  4c21a0e

  Copy full SHA for 4c21a0e

• x1.67 speed up

  Gallaecio

  committed
  c317f9e

  Copy full SHA for c317f9e

• Remove unused code

  Gallaecio

  committed
  7152d0b

  Copy full SHA for 7152d0b

• x1.125 speed up

  Gallaecio

  committed
  9daca87

  Copy full SHA for 9daca87

Commits on Nov 18, 2022

• Use urllib.parse.unquote

  Gallaecio

  committed
  88f32ae

  Copy full SHA for 88f32ae