Jamstack 2020 queries #1228

denar90 · 2020-08-18T10:56:36Z

Queries for the Jamstack 2020 chapter (#878)

Adoption of image formats in SSGs
Core Web Vitals distribution by CDNs hosted top SSGs
Core Web Vitals of CDNs hosted SSGs
Distribution of page weight, requests, and co2 grams per SSG web page
Lighthouse category scores per SSG
SSG adoptions and top SSGs YoY
Core Web Vitals distribution by SSG
Core Web Vitals performance by SSG
Third party bytes and requests on SSGs

→ Spreadsheet

ahmadawais · 2020-09-03T04:19:39Z

Hi @denar90 doesn't look like the query was able to pick up any Next.js websites?

denar90 · 2020-09-03T20:04:20Z

@ahmadawais, yup, we didn't include Next.js due to research - #878 (comment)

ahmadawais · 2020-09-03T20:11:12Z

That comment is not leading anywhere on mobile app. Will check later. But without Nextjs the chapter would be incomplete. It's the biggest Jamstack framework.

denar90 · 2020-09-03T20:17:57Z

Totally agree. In other hand we can provide readers with wrong data, because users can use Next.js differently (like SSR or just SPA). Having no distinguish for that will lead to corrupted data. Maybe we can put "message" to Next.js team, so they can provide some indication for type of Next.js usage. Next year we will be able to include it and be 100% confident in data.

ahmadawais · 2020-09-04T06:39:10Z

I believe that Next is Jamstack. JAM means JavaScript APIs and Markup. It does NOT mean static. SPAs, SSRs, built with Next are different. Next statically optimizes all types of pages CSR/SSR/SSG. They advertise this as well.

These are hybrid apps. Almost every other web app using Gatsby or the likes also has SSR stuff or completely dynamic pages like contact forms and whatnot.

Next belongs to Jamstack. The way you implement SPA with Next.js, the git push, and deploy is also part of the Jamstack philosophy. We might end up with disclaimers — but I plan to mostly write about this as Jamstack and beyond (similar stuff) — since the line is not as clear.

I don't feel comfortable dropping Next.js. I ask you to reconsider and add the statistics for Next.js sites as well.

remotesynth · 2020-09-04T19:13:26Z

It's complicated. I do think Next.js popularity makes it a tough decision to ignore it. I also think Next.js has traditionally been more popular as an SSR solution than a true Jamstack solution. I disagree with @ahmadawais in that it most definitely does mean static - as in static aka pre-rendered assets though not necessarily a static app.

This is why emphasizing the JAM acronym in Jamstack continues to frustrate me because it can lead to confusion like this. An SSR app is not Jamstack, even if the framework is capable of Jamstack. There are hybrid apps using Next.js which blur the lines a bit, but if an SSR app that uses JavaScript on the frontend was the primary criteria, nearly ever web app could claim to be Jamstack and the whole thing becomes meaningless.

So, all that being said, I think we have two options:

Include Next.js with the caveat that it may include a significant number of sites that are not truly Jamstack.
Exclude Next.js with the explanation that it's historical popularity as an SSR solution would muddy the waters too much.

I am honestly fine with either but a worthwhile exercise might be to run a query with Next.js and see if it looks like it would greatly influence the results. How many are there? Do they seem to have differing profiles than the other data based upon a cursory review? My opinion would be, if the results would be substantively different with Next.js, it is probably because it includes a number of irrelevant sites.

denar90 · 2020-09-06T21:17:54Z

@ahmadawais @remotesynth I'm fine having some disclaimer/explanation about Next.js.

I totally reworked queries. Now they includes all SSGs (+ Next.js). Also now we have

core_web_vitals_distribution.sql
core_web_vitals_passing.sql
third_party_bytes_and_requests_on_ssgs.sql

Also started working on GSheet
and planning to have queries similar to #1087

rviscomi · 2020-09-16T22:34:56Z

Be sure to update this from "Draft" to "Ready for review" so we can get more eyes on it

ahmadawais · 2020-09-17T18:05:50Z

@denar90 we are getting close to the deadline. Is it ready from your side to be reviewed?

rviscomi · 2020-09-19T23:35:21Z

sql/2020/17_JAMstack/cdn_core_web_vitals_distribution.sql

+  client,
+  CDN,
+  COUNT(DISTINCT origin) AS origins,
+  SUM(fast_lcp) / (SUM(fast_lcp) + SUM(avg_lcp) + SUM(slow_lcp)) AS good_lcp,


(Throughout) It might not matter but this is simpler and consistent with other CWV queries

Suggested change

SUM(fast_lcp) / (SUM(fast_lcp) + SUM(avg_lcp) + SUM(slow_lcp)) AS good_lcp,

SUM(fast_lcp) / SUM(fast_lcp + avg_lcp + slow_lcp) AS good_lcp,

This comment applies throughout the query

rviscomi · 2020-09-19T23:37:25Z

sql/2020/17_JAMstack/cdn_core_web_vitals_distribution.sql

+JOIN (
+    SELECT
+      CASE
+        WHEN REGEXP_EXTRACT(LOWER(CONCAT(respOtherHeaders, resp_x_powered_by, resp_via, resp_server)), '(x-github-request)') = 'x-github-request' THEN 'GitHub'


(Throughout)

Suggested change

WHEN REGEXP_EXTRACT(LOWER(CONCAT(respOtherHeaders, resp_x_powered_by, resp_via, resp_server)), '(x-github-request)') = 'x-github-request' THEN 'GitHub'

WHEN REGEXP_CONTAINS(CONCAT(respOtherHeaders, resp_x_powered_by, resp_via, resp_server), '(?i)x-github-request') THEN 'GitHub'

This comment applies throughout the query

rviscomi · 2020-09-19T23:40:51Z

sql/2020/17_JAMstack/cdn_core_web_vitals_distribution.sql

+    FROM
+      `httparchive.summary_requests.2020_08_01_*`


(Throughout) Do you also need a WHERE firstHtml clause here so that you're only looking at requests for pages that are served with these headers, not any misc 3P requests?

Nit: can you take a look at the whitespace related to this change? firstHtml is appearing misaligned with the rest of the query.

Should be aligned

Co-authored-by: Rick Viscomi <[email protected]>

denar90 · 2020-09-22T21:34:00Z

@rviscomi can you have one more look?

rviscomi · 2020-09-22T22:09:19Z

sql/2020/17_JAMstack/ssg_core_web_vitals_distribution.sql

@@ -0,0 +1,65 @@
+#standardSQL
+# Core Web Vitals distribution by SSG


Is this identical to cdn_core_web_vitals_distribution.sql?

yup, I merged them into 1 query.

rviscomi · 2020-09-22T22:10:52Z

sql/2020/17_JAMstack/ssg_core_web_vitals_passing.sql

@@ -0,0 +1,85 @@
+#standardSQL
+# Core Web Vitals performance by CMS


Is this the same as cdn_core_web_vitals_passing.sql? I see that it's querying 2020_07, but not sure if that's intentional.

Should be 2020_08, thanks

sql/2020/17_JAMstack/core_web_vitals_distribution.sql

sql/2020/17_JAMstack/core_web_vitals_passing.sql

sql/2020/17_JAMstack/distribution_of_page_weight_requests_and_co2_grams_per_ssg_web_page.sql

sql/2020/17_JAMstack/median_lighthouse_score.sql

rviscomi · 2020-10-06T01:47:53Z

sql/2020/17_JAMstack/ssg_compared_to_2019.sql

+  LOWER(category) = "static site generator" OR
+  app = "Next.js"


Aside: should Next.js be categorized as SSG? If so could you open an issue on the Wappalyzer repo? https://github.com/AliasIO/wappalyzer/

For now it's hard to say. I included that regarding our last discussion #1228 (comment)
I expect some reaction from Next.js team after publishing the chapter, so they can add some markers which will help Wappalyzer detect Next.js when it's used as SSG.

sql/2020/17_JAMstack/third_party_bytes_and_requests_on_ssgs.sql

Co-authored-by: Rick Viscomi <[email protected]>

denar90 · 2020-10-12T08:04:44Z

@rviscomi can we merge it, or do I have to change something more?

rviscomi · 2020-10-12T16:08:29Z

Ship it!

add cdn_ttfb query

abfa2fe

denar90 added the analysis Querying the dataset label Aug 18, 2020

denar90 mentioned this pull request Aug 30, 2020

Jamstack 2020 #878

Closed

10 tasks

Update cdn_ttfb.sql

220e480

foxdavidj added this to the 2020 Analysis milestone Aug 31, 2020

denar90 added 3 commits September 4, 2020 23:51

Add CWV for SSG

57afea3

Add CWV distribution, thirdparty requests

f2f785c

Rename third party bytes

4bef195

denar90 added 2 commits September 9, 2020 00:11

Improve CWV passing, add ssg adoption comparing to 2019

32a022e

Add more queries

e882389

rviscomi requested changes Sep 19, 2020

View reviewed changes

rviscomi marked this pull request as ready for review September 19, 2020 23:43

rviscomi requested a review from a team September 19, 2020 23:43

rviscomi assigned denar90 Sep 19, 2020

denar90 and others added 5 commits September 22, 2020 22:50

Update sql/2020/17_JAMstack/cdn_core_web_vitals_distribution.sql

84c2751

Co-authored-by: Rick Viscomi <[email protected]>

Update sql/2020/17_JAMstack/cdn_core_web_vitals_distribution.sql

dbe7ab3

Co-authored-by: Rick Viscomi <[email protected]>

Unitize ssg adoption query yoy

c4fed39

Use firstHtml for summary_requests, adjust readme

32ac677

Add CO2, image adoption, LH median results

4444b47

denar90 added 2 commits September 23, 2020 00:28

Fix namings

a927768

add image adoption queries

12e59ba

rviscomi requested changes Sep 22, 2020

View reviewed changes

denar90 added 2 commits October 5, 2020 10:32

Align WV query

f9bdff6

alignment

c2b17b1

rviscomi requested changes Oct 6, 2020

View reviewed changes

denar90 and others added 4 commits October 6, 2020 23:27

Update sql/2020/17_JAMstack/core_web_vitals_distribution.sql

d806fd0

Co-authored-by: Rick Viscomi <[email protected]>

Update sql/2020/17_JAMstack/median_lighthouse_score.sql

433ec37

Co-authored-by: Rick Viscomi <[email protected]>

Update sql/2020/17_JAMstack/core_web_vitals_passing.sql

ee7ae15

Co-authored-by: Rick Viscomi <[email protected]>

Update sql/2020/17_JAMstack/third_party_bytes_and_requests_on_ssgs.sql

408e5d0

Co-authored-by: Rick Viscomi <[email protected]>

rviscomi approved these changes Oct 12, 2020

View reviewed changes

rviscomi merged commit 2815281 into main Oct 12, 2020

rviscomi deleted the jamstack-sql-2020 branch October 12, 2020 16:08

denar90 mentioned this pull request Sep 28, 2021

Jamstack 2021 queries #2349

Merged

10 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Jamstack 2020 queries #1228

Jamstack 2020 queries #1228

denar90 commented Aug 18, 2020 •

edited by ahmadawais

Loading

ahmadawais commented Sep 3, 2020

denar90 commented Sep 3, 2020

ahmadawais commented Sep 3, 2020

denar90 commented Sep 3, 2020

ahmadawais commented Sep 4, 2020

remotesynth commented Sep 4, 2020

denar90 commented Sep 6, 2020

rviscomi commented Sep 16, 2020

ahmadawais commented Sep 17, 2020

rviscomi Sep 19, 2020 •

edited

Loading

rviscomi Sep 22, 2020

rviscomi Sep 19, 2020

rviscomi Sep 22, 2020

rviscomi Sep 19, 2020

denar90 Sep 22, 2020

rviscomi Sep 22, 2020

denar90 Oct 5, 2020

denar90 commented Sep 22, 2020

rviscomi Sep 22, 2020

denar90 Oct 5, 2020

rviscomi Sep 22, 2020

denar90 Oct 5, 2020

rviscomi Oct 6, 2020

denar90 Oct 6, 2020

denar90 commented Oct 12, 2020

rviscomi commented Oct 12, 2020

	SUM(fast_lcp) / (SUM(fast_lcp) + SUM(avg_lcp) + SUM(slow_lcp)) AS good_lcp,
	SUM(fast_lcp) / SUM(fast_lcp + avg_lcp + slow_lcp) AS good_lcp,

	WHEN REGEXP_EXTRACT(LOWER(CONCAT(respOtherHeaders, resp_x_powered_by, resp_via, resp_server)), '(x-github-request)') = 'x-github-request' THEN 'GitHub'
	WHEN REGEXP_CONTAINS(CONCAT(respOtherHeaders, resp_x_powered_by, resp_via, resp_server), '(?i)x-github-request') THEN 'GitHub'

		@@ -0,0 +1,65 @@
		#standardSQL
		# Core Web Vitals distribution by SSG

		@@ -0,0 +1,85 @@
		#standardSQL
		# Core Web Vitals performance by CMS

Jamstack 2020 queries #1228

Jamstack 2020 queries #1228

Conversation

denar90 commented Aug 18, 2020 • edited by ahmadawais Loading

ahmadawais commented Sep 3, 2020

denar90 commented Sep 3, 2020

ahmadawais commented Sep 3, 2020

denar90 commented Sep 3, 2020

ahmadawais commented Sep 4, 2020

remotesynth commented Sep 4, 2020

denar90 commented Sep 6, 2020

rviscomi commented Sep 16, 2020

ahmadawais commented Sep 17, 2020

rviscomi Sep 19, 2020 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

denar90 commented Sep 22, 2020

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

denar90 commented Oct 12, 2020

rviscomi commented Oct 12, 2020

denar90 commented Aug 18, 2020 •

edited by ahmadawais

Loading

rviscomi Sep 19, 2020 •

edited

Loading