Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate mass disappearance of media links #713

Closed
hancush opened this issue Apr 6, 2021 · 3 comments
Closed

Investigate mass disappearance of media links #713

hancush opened this issue Apr 6, 2021 · 3 comments
Assignees

Comments

@hancush
Copy link
Collaborator

hancush commented Apr 6, 2021

On 3/27, media links disappeared from all events on the Board Agendas site. Our scrape logs indicate that this disappearance and subsequent reappearance happened all at once, suggesting that something upstream went wrong. I've outlined what happened, as well as how we scrape media links, in this document: https://docs.google.com/document/d/1kqqs46T8wuSt3xpcK8REwBA_QxVPV-cwA4FQAmfuMec/edit?usp=sharing

@camachoo is going to sync with Granicus to see if our theory of a temporary blip in Legistar is feasible. This will help to determine next steps, if any.

@hancush hancush self-assigned this May 5, 2021
@hancush
Copy link
Collaborator Author

hancush commented May 11, 2021

I will mark Granicus maintenance on our calendar so we can be aware of potential issues: https://status.granicus.com/

@hancush
Copy link
Collaborator Author

hancush commented May 11, 2021

This seems to happen very rarely. If we continue to see this type of issue, however, it could be useful for pupa to send an alert if all objects (or some high threshold of objects) are updated in a single scrape. I will open an issue over in that repo to bookmark that idea.

@hancush
Copy link
Collaborator Author

hancush commented May 21, 2021

Opened opencivicdata/pupa#340, will drop into deep freeze unless something like this recurs.

@hancush hancush closed this as completed May 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant