GitHub - h4ck3rm1k3/rootstrikers-wikipedia: more tools to update congress members wikipedia pages from various sources

h4ck3rm1k3 / rootstrikers-wikipedia Public

Notifications You must be signed in to change notification settings
Fork 2
Star 2

more tools to update congress members wikipedia pages from various sources

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 168 Commits
FECFieldDocumentation @ 657e09c		FECFieldDocumentation @ 657e09c
congress-legislators @ e66678b		congress-legislators @ e66678b
maplight-convert @ 3fab7e1		maplight-convert @ 3fab7e1
.gitignore		.gitignore
.gitmodules		.gitmodules
Ballotpedia.py		Ballotpedia.py
Ballotpedia_house.py		Ballotpedia_house.py
Ballotpedia_senator.py		Ballotpedia_senator.py
CRP_IDs.py		CRP_IDs.py
CRP_IDs.txt		CRP_IDs.txt
Current_members_of_the_United_States_House_of_Representatives.py		Current_members_of_the_United_States_House_of_Representatives.py
List_of_current_United_States_Senators.py		List_of_current_United_States_Senators.py
Makefile		Makefile
Readme.txt		Readme.txt
cache.py		cache.py
check_opencong.py		check_opencong.py
checkin.sh		checkin.sh
compare.py		compare.py
compare_crp.py		compare_crp.py
compare_leg.py		compare_leg.py
dump.py		dump.py
encode.py		encode.py
fec_electronic_contrib.py		fec_electronic_contrib.py
fec_loader.py		fec_loader.py
fec_reports.py		fec_reports.py
fecdetails.py		fecdetails.py
fecfields.py		fecfields.py
fech.py		fech.py
fech_rendered_maps.py		fech_rendered_maps.py
fechbase.py		fechbase.py
fechout.py		fechout.py
field_types.py		field_types.py
generate_fields.py		generate_fields.py
legis_getpages.py		legis_getpages.py
legis_index_links.py		legis_index_links.py
legislators_current.py		legislators_current.py
legislators_other.py		legislators_other.py
maplight_FEC2012c1_1.py		maplight_FEC2012c1_1.py
maplight_FEC2012c2.py		maplight_FEC2012c2.py
maplight_contributions.py		maplight_contributions.py
maplight_convert.py		maplight_convert.py
maplight_convert2.py		maplight_convert2.py
maplight_name.py		maplight_name.py
opencongress.py		opencongress.py
opencongress_wiki.py		opencongress_wiki.py
opencongress_xml.py		opencongress_xml.py
parsefec.py		parsefec.py
parsefec2.py		parsefec2.py
parsefec_individual.py		parsefec_individual.py
report.txt		report.txt
socrata_rows.py		socrata_rows.py
test.py		test.py
test_legis.py		test_legis.py
test_reps.py		test_reps.py
washpost.py		washpost.py
washpost_search.py		washpost_search.py
wiki.py		wiki.py
wikipedia_conglinks.py		wikipedia_conglinks.py

Repository files navigation

FECH reimplementation :

This contains fech.py, a rewrite of the fech project in python.
It uses a code generator for creating the record objects
 [email protected]:h4ck3rm1k3/FEC-Field-Documentation.git
which is checked out into FECFieldDocumentation

The results will be published here :
	[email protected]:h4ck3rm1k3/federal-election-commision-aggregation.git in
	the branch rawdata


CRP_IDs.txt 
-----------

Source :
Open Secrets http://www.opensecrets.org/
Data file here :http://www.opensecrets.org/downloads/crp/CRP_IDs.xls

contains basic data about  the Candidate and connects the FECID to to CID.
Uploaded to google docs.
https://docs.google.com/spreadsheet/ccc?key=0AoQovvVR7xyxdFhMVlhvUHdRSXR5V1dHXzZuM3JaOUE#gid=0

Maplight 
---------
The site http://maplight.org/ has a data api. It pulls in FEC data. 

Example :
{"display_name":"Barack Obama","statecode":"US","office_body":"E","office_title":"President","district":"","district_sort":"","party_name":"Democratic","description":"57th Administration","start_date":"2013-01-20","end_date":"2017-01-20","sworn_in":"2013-01-20","person_id":"7258"},

This is from http://data.maplight.org/FEC/active_incumbents.json

Example data: http://data.maplight.org/FEC/2012/summaries/all.json or from 2014 :http://data.maplight.org/FEC/2014/summaries/all.json

Here is an example from 2012 :
{"person_id":"7258","last_name":"Obama","first_name":"Barack","full_name":"Barack Obama","gender":"M","party":"Democratic","state":"US","office_running":"President","district_running":"","ico":"I","status":"Won","status_date":"Nov 6, 2012","office_holding":null,"district_holding":null,"contrib_start":"Jan 1, 2011","contrib_end":"Jun 23, 2013","contrib_total":"722309354","url_photo":"http:\/\/images.maplight.org\/persons\/7258.jpg","top_orgs":{"1":{"name":"U.S. Government","total":"2887185"},"2":{"name":"University of California","total":"1000166"},"3":{"name":"Microsoft","total":"641217"},"4":{"name":"Google","total":"591093"},"5":{"name":"Kaiser Permanente","total":"563238"},"6":{"name":"Harvard University","total":"510130"},"7":{"name":"Stanford University","total":"390581"},"8":{"name":"DLA Piper","total":"354834"},"9":{"name":"Columbia University","total":"339650"},"10":{"name":"Sidley Austin","total":"338490"},"11":{"name":"Deloitte","total":"322016"},"12":{"name":"Comcast","total":"271545"},"13":{"name":"University of Chicago","total":"260746"},"14":{"name":"International Business Machines","total":"254220"},"15":{"name":"JPMorgan Chase","total":"244382"},"16":{"name":"Apple","total":"237143"},"17":{"name":"Disney","total":"236660"},"18":{"name":"Skadden, Arps, Slate, Meagher & Flom","total":"233183"},"19":{"name":"University of Michigan","total":"232744"},"20":{"name":"Time Warner","total":"228751"}},"all_count":"2133","all_rank":"1","chamber_count":"116","chamber_rank":1},

The IDs from maplight can be seen in the image urls html : data.maplight.org/FEC/2012/summaries/all.html, The ids are not usable directly on the front end.