-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathProject-TWLY.html
277 lines (226 loc) · 18.5 KB
/
Project-TWLY.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"/>
<title>Project TWLY</title>
<link rel="stylesheet" href="/stylesheets/screen.css" type="text/css" charset="utf-8" />
<link rel="stylesheet" href="/stylesheets/stylesheet.css" type="text/css" charset="utf-8" />
<link rel="stylesheet" href="/stylesheets/gollum.css" type="text/css" charset="utf-8" />
<link rel="stylesheet" href="/stylesheets/syntax.css" type="text/css" charset="utf-8" />
<link rel="stylesheet" type="text/css" href="stylesheets/print.css" media="print" />
<script src="/javascripts/jquery-1.4.2.min.js" type="text/javascript"></script>
<script src="/javascripts/jquery.text_selection-1.0.0.min.js" type="text/javascript"></script>
<script src="/javascripts/jquery.previewable_comment_form.js" type="text/javascript"></script>
<script src="/javascripts/jquery.tabs.js" type="text/javascript"></script>
<script src="/javascripts/gollum.js" type="text/javascript"></script>
<script src="/javascripts/MathJax/MathJax.js" type="text/javascript">
MathJax.OutputJax.fontDir = "http://github-assets.s3.amazonaws.com/javascripts/MathJax/fonts"
MathJax.Hub.Config({
jax: ["input/TeX", "output/HTML-CSS"]
})
</script>
</head>
<body>
<header>
<div class="inner">
<h1>零時政府 g0v.tw</h1>
<a href="https://github.com/g0v" class="button"><small>View projects on</small>GitHub</a>
</div>
</header>
<div id="content-wrapper">
<div class="inner clearfix">
<section id="main-content">
<div id="main">
<div class="site">
<div id="guides">
<div class="guide">
<div class="main">
<div class="actions">
<div>
<a href="/Home.html">Home</a>
</div>
</div>
<h1>Project TWLY</h1>
<div class="content wikistyle gollum markdown">
<h2>立法院公報 parser<a class="anchor" id="ç«æ³é¢å
¬å ±-parser" href="#ç«æ³é¢å
¬å ±-parser"></a></h2>
<p>包含院會紀錄、委員會紀錄、質詢事項等等.</p>
<p>原始格式是 .doc 檔, 目前由 @clkao 把 .doc 用 unoconv 轉成 html, 再處理成純文字檔的 raw data.
之後再對 txt 做 Structure Parse 轉成 markdown, 其中已經能得知的資訊則以 json 註解起來, 最後再針對 markdown做 Semantic
分析產生成 json。</p>
<p>提供 API, 院會紀錄/委員會紀錄特定 section 的永久連結</p>
<ul><li>urn 制定中：<a href="http://opendatatw.wikidot.com/gazette">http://opendatatw.wikidot.com/gazette</a> (by @jftsai)
<ul><li>please help defining: 臨時提案、委員會紀錄、議事錄</li>
</ul></li>
</ul><p><a href="https://github.com/g0v/ly-gazette/blob/master/raw/index.md">公報列表</a></p>
<p>成員</p>
<ul><li>clkao</li>
<li>kcwu</li>
<li>hychen</li>
<li>(please add yourself)</li>
</ul><p>聯絡方式:</p>
<ul><li>IRC #g0v.tw on freenode.net</li>
<li>irc meeting 固定時間：每週一 20:00pm-20:30pm (暫定)</li>
</ul><p>VCS: </p>
<ul><li><a href="https://github.com/g0v/twlyparser">Parser Source</a></li>
<li><a href="https://github.com/g0v/ly-gazette">Rawdata</a></li>
</ul><p>官方正式網站:</p>
<ul><li><a href="http://npl.ly.gov.tw/do/www/dbMaintainNew?dbKind=%E7%AB%8B%E6%B3%95%E9%99%A2%E6%99%BA%E5%BA%AB">立法院智庫</a></li>
<li><a href="http://lis.ly.gov.tw/lgcgi/ttswebpw?in_out/meetin">立法院議事系統</a></li>
<li><a href="http://lis.ly.gov.tw/lgcgi/ttswebpw?in_out/qrin">立法院質詢系統</a> ( pofeng 註: 找過 "禮貌" keyword 沒辦法找到 clkao 找出的資料 )</li>
</ul><h3>Regular Expression Rules 定義<a class="anchor" id="Regular-Expression-Rules-å®ç¾©" href="#Regular-Expression-Rules-å®ç¾©"></a></h3>
<p>the idea is to define a yaml file, so we can share the regex rules for
each different steps. currently, we will have at least 5 steps as below</p>
<ul><li>doc (source)</li>
<li>html (doc -> html)</li>
<li>text (filter useless html code)</li>
<li>markdown (structured data)</li>
<li>json </li>
</ul><h4>todo<a class="anchor" id="todo" href="#todo"></a></h4>
<p>to use named capture variable in regex string.</p>
<ul><li>for javascript, need to use <a href="http://xregexp.com/">http://xregexp.com/</a>.</li>
</ul><h4>example<a class="anchor" id="example" href="#example"></a></h4>
<div class="highlight"><pre><span class="c"># * 結構說明</span>
<span class="c"># </span>
<span class="c"># 群組</span>
<span class="c"># 規則名稱</span>
<span class="c"># Regex 字串</span>
<span class="o">---</span>
<span class="n">_alias</span><span class="p">:</span>
<span class="n">first_last_name</span><span class="p">:</span> <span class="c"># alias name</span>
<span class="n">regex</span><span class="p">:</span> <span class="o">|</span>
<span class="p">(</span><span class="o">\</span><span class="n">s</span><span class="p">{</span>1<span class="p">,</span>2<span class="p">})</span>委員<span class="p">(</span><span class="o">\</span><span class="n">s</span><span class="p">{</span>1<span class="p">,</span>3<span class="p">})</span>
<span class="n">formater</span><span class="p">:</span>
<span class="o">-</span> <span class="n">last_name</span>
<span class="o">-</span> <span class="n">first_name</span>
<span class="n">common</span><span class="p">:</span>
<span class="n">conversationline</span><span class="p">:</span> <span class="c"># 主席: 發言內容</span>
<span class="n">regex</span><span class="p">:</span> <span class="o">|</span>
^<span class="p">(</span>?<span class="o"><</span><span class="n">speaker</span><span class="o">></span><span class="p">[</span>^：<span class="p">]{</span>2<span class="p">,</span>10<span class="p">})</span>：<span class="p">(</span>?<span class="o"><</span><span class="n">content</span><span class="o">>.*</span><span class="p">)</span>
<span class="n">header</span><span class="p">:</span>
<span class="nb">title</span><span class="p">:</span> <span class="c"># 公報標題</span>
<span class="n">regex</span><span class="p">:</span> <span class="o">|</span>
立法院第<span class="p">(</span>?<span class="o"><</span><span class="n">ad</span><span class="o">>\</span><span class="n">S</span><span class="o">+</span><span class="p">)</span>屆第<span class="p">(</span>?<span class="o"><</span><span class="n">session</span><span class="o">>\</span><span class="n">S</span><span class="o">+</span><span class="p">)</span>會期第<span class="p">(</span>?<span class="o"><</span><span class="n">sitting</span><span class="o">>\</span><span class="n">S</span><span class="o">+</span>?<span class="p">)</span>次<span class="p">(</span>?<span class="o"><</span><span class="n">extra</span><span class="o">></span>?<span class="p">:</span>臨時會第<span class="p">(</span><span class="o">\</span><span class="n">S</span><span class="o">+</span><span class="p">)</span>次<span class="p">)</span>?會議紀錄
<span class="n">questioning</span><span class="p">:</span>
<span class="n">reply_from_government</span><span class="p">:</span>
<span class="n">regex</span><span class="p">:</span> <span class="o">|</span>
函送<span class="c">%first_last_name%就(.*)所提質詢之書面答復，請查照案 # 使用alias</span>
<span class="n">formater</span><span class="p">:</span>
<span class="o">-</span> <span class="nb">title</span>
</pre></div>
<h2>委員基本資料<a class="anchor" id="å§å¡åºæ¬è³æ" href="#å§å¡åºæ¬è³æ"></a></h2>
<p>VCS: <a href="https://github.com/ronnywang/TWLegisllativeYuanData">Parser and Json</a></p>
<h3>Avatar API<a class="anchor" id="Avatar-API" href="#Avatar-API"></a></h3>
<p>提供 script include api 把 <span class="mly">名字</span>代換成有頭像、政黨 (可由 class 設定), 並且加上 infobox Kirsten Li(報名幫忙放這裡ok嗎?)</p>
<p>Usage:</p>
<div class="highlight"><pre><span class="s">'http://avatars.io/50a65bb26e293122b0000073/'</span> <span class="o">+</span> <span class="n">hash</span> <span class="o">+</span> "?<span class="nb">size</span><span class="p">=</span>#<span class="n">type</span>"
<span class="n">where</span> <span class="n">hash</span> <span class="p">=</span> <span class="n">crypto</span><span class="p">.</span><span class="n">createHash</span><span class="p">(</span><span class="s">'md5'</span><span class="p">).</span><span class="n">update</span><span class="p">(</span>"<span class="n">MLY</span><span class="o">/</span>#<span class="n">name</span>"<span class="p">).</span><span class="n">digest</span><span class="p">(</span><span class="s">'hex'</span><span class="p">)</span>
</pre></div>
<p>available type:</p>
<ul><li>small</li>
<li>medium</li>
<li>large</li>
</ul><p>Example: </p>
<div class="highlight"><pre><span class="n">md5</span><span class="p">(</span>"<span class="n">MLY</span><span class="o">/</span>吳育昇"<span class="p">)</span> <span class="p">=</span> <span class="n">be4f880741f86268f97812c3faec9571</span>
<span class="n">img</span> <span class="n">is</span><span class="p">:</span>
<span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">avatars</span><span class="p">.</span><span class="n">io</span><span class="o">/</span>50<span class="n">a65bb26e293122b0000073</span><span class="o">/</span><span class="n">be4f880741f86268f97812c3faec9571</span>?<span class="nb">size</span><span class="p">=</span><span class="n">small</span>
</pre></div>
<h2>公報閱讀器<a class="anchor" id="å
¬å ±é±è®å¨" href="#å
¬å ±é±è®å¨"></a></h2>
<p>用網頁閱讀公報</p>
<p>成員: </p>
<ul><li>clako</li>
<li>hlb</li>
</ul><p>聯絡方式:</p>
<ul><li><p>IRC #g0v.tw on freenode.net</p></li>
<li><p>網站: <a href="http://ly.g0v.tw.jit.su/#/sitting">http://ly.g0v.tw.jit.su/#/sitting</a> </p></li>
<li><p>設計雛型：<a href="http://twlyreader-prototype.herokuapp.com/reader.html?json_url=/json/3948_interp.json">http://twlyreader-prototype.herokuapp.com/reader.html?json_url=/json/3948_interp.json</a></p></li>
<li><p>VCS: <a href="https://github.com/g0v/ly.g0v.tw">網站源碼</a></p></li>
<li><p>搜尋功能：<a href="http://open.ly.g0v.tw/">http://open.ly.g0v.tw/</a></p></li>
</ul><h2>委員投票紀錄<a class="anchor" id="å§å¡æ票ç´é" href="#å§å¡æ票ç´é"></a></h2>
<ul><li>這邊有點複雜... 因為投票可分記名/不記名, 所以只能針對記名部份先做。</li>
<li>議事錄內的投票紀錄是附件, 要怎樣去跟原議題做連結，可能要思考一下。</li>
<li>議事錄記名投票解析 <a href="https://github.com/nansenat16/tw-legis-log-parser">https://github.com/nansenat16/tw-legis-log-parser</a>
example: p.84 <a href="http://lci.ly.gov.tw/LyLCEW/agendarec1/02/pdf/08/02/09/LCEWC03_080209.pdf">http://lci.ly.gov.tw/LyLCEW/agendarec1/02/pdf/08/02/09/LCEWC03_080209.pdf</a>
註：此範例僅是「增列討論事項是否列入院會」的投票，並非針對某議案</li>
<li>投票可分：公告事項有異議投票、黨團提案列入議程投票、討論事項內容、法案逐條表決... 請熟悉議事規則的朋友補充</li>
<li>是指這個嗎 - 立法程序 <a href="http://www.ly.gov.tw/02_introduce/0201_intro/introView.action?id=9&itemno=02010900">http://www.ly.gov.tw/02_introduce/0201_intro/introView.action?id=9&itemno=02010900</a></li>
<li>demo：<a href="http://g0v.github.com/ly-vote/">http://g0v.github.com/ly-vote/</a></li>
</ul><h2>審議條文對照表修法 diff viewer<a class="anchor" id="審è°æ¢æå°ç
§è¡¨ä¿®æ³-diff-viewer" href="#審è°æ¢æå°ç
§è¡¨ä¿®æ³-diff-viewer"></a></h2>
<p>本國範例: 難以閱讀</p>
<ul><li>現行法條文 vs 行政院提案條文</li>
<li>現行法條文 vs each 委員、黨團提案條文 ( click to view)
<ul><li>連動「行政院提案說明」與「委員、黨團提案說明」</li>
</ul></li>
<li>basically: parse the table into 現行、各版本(條文+說明), then UI for viewing</li>
<li>他國範例：突尼西亞 OpenGovTN
<ul><li>this seems just a normal diff tool, we probably want something
web-based with both line/char highlight support and some basic UI
for choose which version to diff</li>
</ul></li>
</ul><p>目前demo：<a href="http://ly.g0v.tw.jit.su/#/bill/1011130070300200">http://ly.g0v.tw.jit.su/#/bill/1011130070300200</a></p>
<h2>各提案的追蹤<a class="anchor" id="åææ¡ç追蹤" href="#åææ¡ç追蹤"></a></h2>
<p>成員</p>
<ul><li>nameofevil </li>
</ul><p>notes:</p>
<ul><li>希望能將提案從提案到目前狀況(待省議、通過、否決)做整理。並能加上搜尋功能，讓一般大眾能夠比較注意到，尤其是跟自身相關的議題。</li>
<li>dashboard - 如 KanBan 般的法案一覽表，每個法案目前現況，距離上次更新時間</li>
<li>目前官方的系統: 立法院法律提案審議進度系統( <a href="http://lis.ly.gov.tw/lgcgi/ttswebpw?in_out/mempropg08in">http://lis.ly.gov.tw/lgcgi/ttswebpw?in_out/mempropg08in</a> )</li>
<li>可配合 "立法程序" 一起看 ( <a href="http://www.ly.gov.tw/02_introduce/0201_intro/introView.action?id=9&itemno=02010900">http://www.ly.gov.tw/02_introduce/0201_intro/introView.action?id=9&itemno=02010900</a> )</li>
</ul><h2>立法院公報的推荐系統<a class="anchor" id="ç«æ³é¢å
¬å ±çæ¨è系統" href="#ç«æ³é¢å
¬å ±çæ¨è系統"></a></h2>
<p>收集公民的瀏覽紀錄，甚至是評分(針對公報，以及與會立委)
依據收集的資料來建立推荐系統(user: 公民 item: 立委或是會議的tag)，將公報推荐給可能感興趣的公民可以統計收集的資料來建立類似民調的分析結果</p>
<p>member:</p>
<ul><li>wush</li>
</ul><p>notes:</p>
<ul><li>@pofeng 先有跨年份的全文搜索，然後加 annotation 可以達到類似的功能，類似(已經關閉的) Google Sidewiki</li>
<li>既有的open source 推荐系統：
<ul><li>Java </li>
<li>LensKit(<a href="http://lenskit.grouplens.org/">http://lenskit.grouplens.org/</a>) </li>
<li>easyrec(<a href="http://easyrec.org">http://easyrec.org</a>)</li>
<li>Python</li>
<li>Crab(<a href="https://github.com/muricoca/crab">https://github.com/muricoca/crab</a>)</li>
<li>PHP</li>
<li>Vogoo(<a href="http://sourceforge.net/projects/vogoo">http://sourceforge.net/projects/vogoo</a>) 這我已經有成功架起來，可和PostgreSQL整合，用起來不困難。同時提供User based、Item based的推荐功能。但是最後一次更新是3年前。需自行擴充或除錯。</li>
<li>R
recommenderlab(<a href="http://r-forge.r-project.org/projects/recommenderlab/">http://r-forge.r-project.org/projects/recommenderlab/</a>) 這是一個供測試和開發演算法用的framework</li>
</ul></li>
</ul><h2>pressure your 立法委員<a class="anchor" id="pressure-your-ç«æ³å§å¡" href="#pressure-your-ç«æ³å§å¡"></a></h2>
<ul><li>provide site / API to request statement for issues from your MLY
probably starting from a congress api? <a href="http://services.sunlightlabs.com/docs/Sunlight_Congress_API/">http://services.sunlightlabs.com/docs/Sunlight_Congress_API/</a></li>
<li>問：能跟公民監督國會聯盟的歷屆立委評比資料串起來嗎？</li>
</ul><h2>議事影音整理<a class="anchor" id="è°äºå½±é³æ´ç" href="#è°äºå½±é³æ´ç"></a></h2>
<ul><li>Needs Tech: ivod 上有議員問政影音，但是在Windows上才能看(需要MediaPlayer plugin)。想要把影片都抓下來放到youtube上，有人嘗試過嗎? @jftsai</li>
<li>@pofeng: 好像可用 NetTransport 下載 <a href="http://www.xi-soft.com/default.htm">http://www.xi-soft.com/default.htm</a></li>
<li>pofeng: 多謝，之前在opendata.tw google group也有人建議用這個軟體，不過使用上會遇到重複抓取的問題，不知可有建議？</li>
<li>Mac 的朋友，可以試試看 Flip4Mac 這個 plugin。(感謝 Jyun-Fan Tsai 提供此資訊)</li>
<li>Kirsten Liu:我嘗試過最笨的手動用ie開, 載(這部分我還沒有試這個能不能拉下來,有的可以), 手動上傳, 如果載的部分能解決的話要自動化應該能做到
NeedsWriter: @ipa , @pofeng , @rcchiu
goo.gl/cBBLL</li>
<li>NeedsDesigner: @hlb</li>
<li>NeedsTalkingToRealPerson: 如何要求立法院釋出公報初稿？</li>
<li>"公報初稿(目前僅開放立法院內檢索利用)" <a href="http://www1.stat.gov.tw/fp.asp?xItem=8575&ctNode=1640">http://www1.stat.gov.tw/fp.asp?xItem=8575&ctNode=1640</a>
"委員口頭質詢或發言之速記錄，經刊印公報初稿後分送發言人，發言人如有文字修正，應於三日內通知更正，屆期未通知者即照初稿編印立法院公報，按期發行" <a href="http://laws.mywoo.com/1/4/320.html">http://laws.mywoo.com/1/4/320.html</a></li>
<li>11/23 在「政府資料開放加值應用研究諮詢座談會」遇到陳學聖立委助理（看報名名單似乎是唯一有來參加的立委辦公室）蔡先生。他說後來未開放的原因實際是「擔心反對黨立委拿未訂正的初稿來開記者會，但其實(院內)大家都是拿得到的」clkao: 「如果即時公布，不是更有助於澄清錯誤，並且提供上下文避免斷章取義？」他說會和公報處聯絡看如何進行</li>
<li>老牌的 <a href="http://www.opencongress.org">http://www.opencongress.org</a> 有釋出源碼（<a href="https://github.com/opencongress/opencongress%EF%BC%89%EF%BC%8C%E5%8C%85%E6%8B%AC%E6%B3%95%E6%A1%88%E8%BF%BD%E8%B9%A4%E3%80%81%E6%8A%95%E7%A5%A8%E8%A8%98%E9%8C%84%E3%80%81%E5%80%8B%E8%B3%87...%E7%AD%89%EF%BC%8C%E7%9C%8B%E8%83%BD%E5%90%A6%E5%90%83%E4%B8%8A%E8%BF%B0%E7%9A%84%E8%B3%87%E6%96%99%E7%94%A2%E5%87%BA%E5%8F%B0%E7%81%A3%E7%89%88%EF%BC%9F">https://github.com/opencongress/opencongress），包括法案追蹤、投票記錄、個資...等，看能否吃上述的資料產出台灣版？</a></li>
</ul>
</div>
</div>
</div>
<div class="admin">
<div style="float: left;">
<small>Last edited by <b>ipaaa</b>, 2013-01-13 17:33:07</small>
</div>
</div>
</div>
</div>
</div>
</section>
<aside id="sidebar">
<h2>如何參與</h2>
<ul>
<li>IRC: #g0v.tw on freenode</li>
</ul>
</aside>
</div>
</div>
</body>
</html>