LG-10062 Accept compressed Service Provider

[Sgtpluck]

🎫 Ticket

https://cm-jira.usa.gov/browse/LG-10062

🛠 Summary of changes

This ticket surfaced an issue where, when JSON requests to sync the service providers are over 20k, they are automatically rejected by nginx. We raised the nginx threshold, but also would like to compress requests to make sure the requests stay below the threshold.

It should be merged before 18F/identity-dashboard#667

📜 Testing Plan

Provide a checklist of steps to confirm the changes.

• Pull down this branch locally
• Pull down Compress Service Provider request identity-dashboard#667 for the dashboard
• make run both repos
• Navigate to http://localhost:3001/ and create/save a new app configuration
• Update it with a new cert
• Navigate to http://localhost:3001/service_providers/all (you may have to make yourself an admin via the rails console)
• Click the "Publish Service Providers" button

[zachmargolis]

LGTM, one idea, but not a blocker

[zachmargolis]

So in my mind there are 3 cases we want to handle, in the spirit of "be liberal in what you accept, and strict in what you output":

• GZIP'ed JSON params
• regular JSON params
• form encoded params

So seeing this it seems like we just have empty params for anything that's not gzipped?

Is it possible to allow the other formats in addition to the GZIP? Like something like:

Suggested change

	return {} unless request.headers['Content-Type'] == 'gzip/json'
	body = request.body.read
	return {} unless body.present?
	JSON.parse(Zlib.gunzip(body))
	if request.headers['Content-Type'] == 'gzip/json'
	body = request.body.read
	if body.present?
	JSON.parse(Zlib.gunzip(body))
	else
	{}
	end
	elsif params.key?(:service_provider) # fall back to rails processing of params?
	params.permit(service_provider: {})
	end

[Sgtpluck]

yeah i like that! thanks

[Sgtpluck]

updated in ec73ab3 (#9074)