Skip to content

Commit 8d61fbc

Browse files
committed
Final first draft
- Converted function into function - Generalized the 'Arsip Penelitian Detil' harvester function into the function - Improved the harvesting speed of 'Dana Penelitian/Pengabdian Detil' harvester functions by introducing 7-iteration row http posting method
1 parent 2a39182 commit 8d61fbc

File tree

5 files changed

+1059
-107
lines changed

5 files changed

+1059
-107
lines changed

.gitignore

+1
Original file line numberDiff line numberDiff line change
@@ -133,3 +133,4 @@ dmypy.json
133133
# ---
134134
.old_idea_config_20230418/
135135
.spreadsheet_exports_20230605/
136+
.spreadsheet_exports_20230612/

.idea/workspace.xml

+1-1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

ND.md

+19
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
# Not-Doing List
2+
`Monday, June 12, 2023`
3+
4+
> All ND's are non-essential and non-binding
5+
6+
> [1] On 2023-06-12:
7+
> - Each one of the following harvester functions: ✅ [2023-06-12][Patched to the main program]
8+
> > Dana penelitian detil
9+
> > Dana pengabdian detil
10+
> should utilize '7-multiple row iteration' as used by 'arsip penelitian/pengabdian detil' function,
11+
> so that the harvesting speed can be improved.
12+
>
13+
> - In 'arsip penelitian/pengabdian detil' function, all of the following: ✅ [2023-06-12][Patched to the main program]
14+
> > ...
15+
> > r2 = content.xpath('.../text()')[0].strip()
16+
> > s2 = content.xpath('.../text()')[0].strip()
17+
> > t2 = content.xpath('.../text()')[0].strip()
18+
> > ...
19+
> should be wrapped in 'try-except' clause, to prevent future data empty cases

NSB.md

+5-4
Original file line numberDiff line numberDiff line change
@@ -1,27 +1,28 @@
11
# Next-Sessional Binding
2+
`Tuesday, March 28, 2023`
23

3-
> On 2023-03-28: ❌ [2023-05-22][The GUI control needs to be interwoven with the recursive harvester; cannot use mode detector]
4+
> [1] On 2023-03-28: ❌ [2023-05-22][The GUI control needs to be interwoven with the recursive harvester; cannot use mode detector]
45
> - The 'get_auto_risat_detil()' and 'experiment_6()' functions need to be repaired,
56
> and that's all!
67
> - Everything else seems to work out just fine.
78
> Except the two functions above, the script file remains consistent and working
89
9-
> On 2023-05-22: ✅ [2023-05-29][All clear and all done]
10+
> [2] On 2023-05-22: ✅ [2023-05-29][All clear and all done]
1011
> In the function 'test_harvest_r_1_dana':
1112
> - Obtain the XPATH of each of the 24 components, and try to paint the worksheet
1213
> - DO-OR-DELEGATE: Get all 'anggota' data rows
1314
> - DO-OR-DELEGATE: Integrate with the GUI's control element and then
1415
> convert from 'test_' into 'run_'
1516
16-
> On 2023-05-29: 🔁 [2023-06-05][Some are cleared]
17+
> [3] On 2023-05-29: 🔁 [2023-06-05][Some are cleared]
1718
> Do the following:
1819
> - Fix 'Rumpun Ilmu' column data not showing every information from the Risat site ✅
1920
> Then attempt to generalize 'run_harvest_r_1_dana' into the following functions:
2021
> - run_harvest_c_1_arsip ✅ (successful testing)
2122
> - run_harvest_c_1_dana ✅
2223
> - run_harvest_r_1_arsip 🔁
2324
24-
> On 2023-06-05:
25+
> [4] On 2023-06-05:[2023-06-12][Doned!]
2526
> Do the following:
2627
> - Finish up the 'test_harvest_r_1_arsip' function
2728
> Then generalize 'run_harvest_r_1_arsip' into the following function:

0 commit comments

Comments
 (0)