HTTP/2 2020 queries #1098

gregorywolf · 2020-07-25T12:52:59Z

Progress on #921

All queries have been updated to use the almanac data set

- Copy of all 2019 SQL queries in a single file - Initial SQL query using sample_data

Updated 2019 SQL using sample_data

rviscomi · 2020-07-25T18:15:04Z

Thanks @gregorywolf! Could you edit the PR description to include a checklist of the metrics needed by the chapter and check off the ones implemented in this PR so far? This will help us see at a glance how much work is still left to do.

gregorywolf · 2020-07-26T20:38:52Z

@rviscomi I have updated the PR description as requested. I have also extracted out some suggested metrics from the chapter discussion which I need to determine how to generate. Any assistance would be much appreciated :)

tunetheweb · 2020-07-26T21:07:38Z

Hey @gregorywolf I've edited the initial comment to convert your SUCCESS/FAILS to tick boxes. This then shows how complete they are (14 out of 20) when looking at the issue:

As to your other queries:

How many sites offer H3 by looking at the alt-svc headers

Take a look at 20_04 from last year and 20_04a from last year

TLS 1.3 adoption for H2

That should be easy enough to get. Look at HTTP/2 queries and Security queries from last year.

How many HTTP Headers are sent
Size of HTTP headers

Again 20_04 from last year might give you a way to get started with this.

We also wanted a way to measure HPACK gains, but I asked about this last year and it wasn't possible then so doubt it's possible now.

Hope that helps!

rviscomi · 2020-07-27T00:08:05Z

Thanks @gregorywolf!

Changes reflect the updated August RUN

tunetheweb · 2020-09-11T17:35:06Z

@gregorywolf please see this comment about the fact the prioritisation table has been renamed and dated now.

gregorywolf

I updated the name of the table to be used in the query

Corrected the table name for the CDN prioritization query Added a new line at end of queries

…hive.org into main

rviscomi

Looks great! Some early feedback after looking at the first few queries. The comments apply to the other queries as well.

sql/2020/22_HTTP_2/adoption_of_http_2_by_site_and_requests.sql

sql/2020/22_HTTP_2/avg_number_of_h2_pushed_resources_and_avg_bytes.sql

Updated all of the queries based on feedback from Rick V

…t_of_non_h2_and_h3_sites_grouped_by_server.sql

…number_of_h2_and h3_pushed_resources_and_bytes_transferred.sql

…ent_type.sql to number_of_h2_and_h3_pushed_resources_and_bytes_by_content_type.sql

…ues.sql to percentage_of_h2_and_h3_sites_affected_by_cdn_prioritization.sql

…rade_http_upgrade_header_containing_h2.sql to number_of_https_requests_not_using_h2_or_h3_returning_upgrade_http_upgrade_header_containing_h2.sql

…r_site.sql to percentage_of_resources_loaded_over_HTTP_by_version_per_site.sql

…ng_h2.sql

gregorywolf

All changes made

sql/2020/22_HTTP_2/number_of_h2_and_h3_pushed_resources_and_bytes_by_content_type.sql

sql/2020/22_HTTP_2/number_of_http_requests_returning_upgrade_http_header_containing_h2.sql

...of_https_requests_not_using_h2_or_h3_returning_upgrade_http_upgrade_header_containing_h2.sql

.../22_HTTP_2/number_of_https_requests_using_h2_returning_upgrade_http_header_containing_h2.sql

sql/2020/22_HTTP_2/percentage_of_resources_loaded_over_HTTP_by_version_per_site.sql

…tes_by_content_type.sql Co-authored-by: Rick Viscomi <[email protected]>

…ttp_header_containing_h2.sql Co-authored-by: Rick Viscomi <[email protected]>

…_returning_upgrade_http_upgrade_header_containing_h2.sql Co-authored-by: Rick Viscomi <[email protected]>

…_upgrade_http_header_containing_h2.sql Co-authored-by: Rick Viscomi <[email protected]>

rviscomi

Results for all queries, including suggestions, saved to the chapter sheet.

One outstanding question about CDN chains that may require rerunning the query.

sql/2020/22_HTTP_2/number_of_h2_and_h3_pushed_resources_and_bytes_by_content_type.sql

sql/2020/22_HTTP_2/percentage_of_h2_and_h3_sites_affected_by_cdn_prioritization.sql

sql/2020/22_HTTP_2/percentage_of_resources_loaded_over_HTTP_by_version_per_site.sql

…tes_by_content_type.sql Co-authored-by: Rick Viscomi <[email protected]>

…_version_per_site.sql Co-authored-by: Rick Viscomi <[email protected]>

rviscomi · 2020-09-23T16:18:26Z

With the CDN discussion resolved, all of the queries have been reviewed and their results saved to the sheet, so this PR should be ready to merge and the HTTP/2 chapter should now be ready for the content team to review the results and start writing! 🎉 📝

tunetheweb

A few minor comments from me but happy to merge.

sql/2020/22_HTTP_2/number_of_h2_and h3_pushed_resources_and_bytes_transferred.sql

sql/2020/22_HTTP_2/number_of_h2_and_h3_pushed_resources_and_bytes_by_content_type.sql

gregorywolf added 3 commits July 22, 2020 09:59

SQL

989e103

- Copy of all 2019 SQL queries in a single file - Initial SQL query using sample_data

SQL for 2020 Web Almanac HTTP/2

58fcb45

2020 SQL

6a583a4

Updated 2019 SQL using sample_data

rviscomi changed the title ~~Initial SQL Formatted Queries from 2019~~ HTTP/2 2020 queries Jul 25, 2020

rviscomi added the analysis Querying the dataset label Jul 25, 2020

rviscomi added this to the 2020 Analysis milestone Jul 25, 2020

HTTP/2 2020

14655bf

gregorywolf added 3 commits July 29, 2020 11:55

Update measure_number_of_tcp_connections_per_site.sql

ec6719e

Create new query - TLS 1.3 Adoption for H2

5561308

Updated SQL

ac0848e

Changes reflect the updated August RUN

gregorywolf closed this Sep 10, 2020

gregorywolf reopened this Sep 10, 2020

Update percent_of_sites_affected_by_cdn_prioritization_issues.sql

35c7ebc

gregorywolf commented Sep 11, 2020

View reviewed changes

gregorywolf added 2 commits September 11, 2020 17:25

Updated SQL Queries

d9e573a

Corrected the table name for the CDN prioritization query Added a new line at end of queries

Merge branch 'main' of https://github.com/gregorywolf/almanac.httparc…

2de2d93

…hive.org into main

gregorywolf marked this pull request as ready for review September 11, 2020 21:34

rviscomi requested changes Sep 11, 2020

View reviewed changes

tunetheweb requested a review from a team September 11, 2020 21:53

Updated Queries

a52ed08

Updated all of the queries based on feedback from Rick V

gregorywolf requested a review from rviscomi September 12, 2020 17:04

gregorywolf added 6 commits September 21, 2020 16:20

Update count_of_h2_and_h3_sites_using_push.sql

df8643e

Update and rename count_of_non_h2_sites_grouped_by_server.sql to coun…

51c6f4d

…t_of_non_h2_and_h3_sites_grouped_by_server.sql

Update and rename number_of_h2_pushed_resources_and_avg_bytes.sql to …

30c6bb9

…number_of_h2_and h3_pushed_resources_and_bytes_transferred.sql

Update and rename number_of_h2_pushed_resources_and_avg_bytes_by_cont…

a3334cb

…ent_type.sql to number_of_h2_and_h3_pushed_resources_and_bytes_by_content_type.sql

Update and rename percent_of_sites_affected_by_cdn_prioritization_iss…

05c918b

…ues.sql to percentage_of_h2_and_h3_sites_affected_by_cdn_prioritization.sql

Update and rename number_of_https_requests_not_using_h2_returning_upg…

2fc25e2

…rade_http_upgrade_header_containing_h2.sql to number_of_https_requests_not_using_h2_or_h3_returning_upgrade_http_upgrade_header_containing_h2.sql

gregorywolf requested review from rviscomi and tunetheweb September 22, 2020 00:11

gregorywolf added 5 commits September 21, 2020 20:33

Update and rename percent_of_resources_loaded_over_HTTP_by_version_pe…

68f64ef

…r_site.sql to percentage_of_resources_loaded_over_HTTP_by_version_per_site.sql

Update detailed_upgrade_headers.sql

3f149ed

Update detailed_upgrade_headers.sql

ab8f7f3

Update number_of_http_requests_returning_upgrade_http_header_containi…

d4ba697

…ng_h2.sql

Update tls_adoption_by_http_version.sql

f3f3ce1

gregorywolf commented Sep 22, 2020

View reviewed changes

rviscomi requested changes Sep 22, 2020

View reviewed changes

gregorywolf and others added 5 commits September 21, 2020 21:21

Update sql/2020/22_HTTP_2/number_of_h2_and_h3_pushed_resources_and_by…

57e02d0

…tes_by_content_type.sql Co-authored-by: Rick Viscomi <[email protected]>

Update sql/2020/22_HTTP_2/number_of_http_requests_returning_upgrade_h…

d54b21e

…ttp_header_containing_h2.sql Co-authored-by: Rick Viscomi <[email protected]>

Update sql/2020/22_HTTP_2/number_of_https_requests_not_using_h2_or_h3…

df6bf86

…_returning_upgrade_http_upgrade_header_containing_h2.sql Co-authored-by: Rick Viscomi <[email protected]>

Update sql/2020/22_HTTP_2/number_of_https_requests_using_h2_returning…

3d76b85

…_upgrade_http_header_containing_h2.sql Co-authored-by: Rick Viscomi <[email protected]>

Update percentage_of_resources_loaded_over_HTTP_by_version_per_site.sql

6e1f281

rviscomi requested changes Sep 22, 2020

View reviewed changes

gregorywolf and others added 2 commits September 22, 2020 17:28

Update sql/2020/22_HTTP_2/number_of_h2_and_h3_pushed_resources_and_by…

9010146

…tes_by_content_type.sql Co-authored-by: Rick Viscomi <[email protected]>

Update sql/2020/22_HTTP_2/percentage_of_resources_loaded_over_HTTP_by…

03e9bd1

…_version_per_site.sql Co-authored-by: Rick Viscomi <[email protected]>

rviscomi approved these changes Sep 23, 2020

View reviewed changes

rviscomi merged commit 0a91453 into HTTPArchive:main Sep 23, 2020

tunetheweb approved these changes Sep 23, 2020

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HTTP/2 2020 queries #1098

HTTP/2 2020 queries #1098

gregorywolf commented Jul 25, 2020 •

edited

Loading

rviscomi commented Jul 25, 2020 •

edited

Loading

gregorywolf commented Jul 26, 2020

tunetheweb commented Jul 26, 2020 •

edited

Loading

rviscomi commented Jul 27, 2020

tunetheweb commented Sep 11, 2020

gregorywolf left a comment

rviscomi left a comment

gregorywolf left a comment

rviscomi left a comment

rviscomi commented Sep 23, 2020

tunetheweb left a comment

HTTP/2 2020 queries #1098

HTTP/2 2020 queries #1098

Conversation

gregorywolf commented Jul 25, 2020 • edited Loading

rviscomi commented Jul 25, 2020 • edited Loading

gregorywolf commented Jul 26, 2020

tunetheweb commented Jul 26, 2020 • edited Loading

rviscomi commented Jul 27, 2020

tunetheweb commented Sep 11, 2020

gregorywolf left a comment

Choose a reason for hiding this comment

rviscomi left a comment

Choose a reason for hiding this comment

gregorywolf left a comment

Choose a reason for hiding this comment

rviscomi left a comment

Choose a reason for hiding this comment

rviscomi commented Sep 23, 2020

tunetheweb left a comment

Choose a reason for hiding this comment

gregorywolf commented Jul 25, 2020 •

edited

Loading

rviscomi commented Jul 25, 2020 •

edited

Loading

tunetheweb commented Jul 26, 2020 •

edited

Loading