DedSecInside · PSNAppz · Jul 30, 2018 · May 5, 2018 · May 6, 2018 · May 7, 2018
diff --git a/.gitignore b/.gitignore
@@ -1,18 +1,25 @@
-# Modules
-modules/.ropeproject/
-modules/__pycache__/
-modules/.pytest_cache/
+# Module Ignores
 modules/*.pyc
+modules/__init__.py
+modules/__pycache__/
+modules/.pytest_cache
+modules/.ropeproject/
+modules/lib/*.so
 
-# Tests
-tests/.ropeproject/
+# Tests Ignores
+tests/.pytest_cache
+tests/*.pyc
 tests/__pycache__/
-tests/.pytest_cache/
+tests/.ropeproject/
 
-# Main
-__pycache__
+# Cache
 .cache
+*.pyc
+.pytestc*
+.pytest_cache
+
+# Misc
+torBot
 .*.swp
 .ropeproject/
 .idea/
-.pytest_cache
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -2,6 +2,25 @@
 --------------------
 All notable changes to this project will be documented in this file.
 
+## 1.3.0 | Future
+
+### Changed
+* Moderate code improvements
+* Updated README.md
+* Updated dependencies
+* Modularize and documented Golang library
+* Using Golang library instead of Python library for getting links
+
+### Added
+* Unit tests for Golang Library
+* Installation shell script to create torBot binary
+* Testing documentation for Golang test suite.
+* Test for getting links that uses a Mock Object to reproduce tests without touching actual servers.
+* Script for getting Golang dependencies
+* Script for building Golang shared object 
+* Installs Golang dependencies when install.sh is executed
+
+
 ## 1.2.0 | Present (Stable)
 
 ### Changed

diff --git a/README.md b/README.md
@@ -1,14 +1,43 @@
  <pre>
-
-
-                           ████████╗ ██████╗ ██████╗     ██████╗  ██████╗ ████████╗ 
-                           ╚══██╔══╝██╔═══██╗██╔══██╗    ██╔══██╗██╔═████╗╚══██╔══╝ 
-                              ██║   ██║   ██║██████╔╝    ██████╔╝██║██╔██║   ██║ 
-                              ██║   ██║   ██║██╔══██╗    ██╔══██╗████╔╝██║   ██║
-                              ██║   ╚██████╔╝██║  ██║    ██████╔╝╚██████╔╝   ██║ 
-                              ╚═╝    ╚═════╝ ╚═╝  ╚═╝    ╚═════╝  ╚═════╝    ╚═╝ 
-
 
+                              ████████╗ ██████╗ ██████╗     ██████╗  ██████╗ ████████╗
+                              ╚══██╔══╝██╔═══██╗██╔══██╗    ██╔══██╗██╔═████╗╚══██╔══╝
+                                 ██║   ██║   ██║██████╔╝    ██████╔╝██║██╔██║   ██║
+                                 ██║   ██║   ██║██╔══██╗    ██╔══██╗████╔╝██║   ██║
+                                 ██║   ╚██████╔╝██║  ██║    ██████╔╝╚██████╔╝   ██║
+                                 ╚═╝    ╚═════╝ ╚═╝  ╚═╝    ╚═════╝  ╚═════╝    ╚═╝
+
+
+
+                                                           `.` `     
+                                                       ``.:.--.`     
+                                                      .-+++/-`       
+                                                     `+sso:`         
+                                                  `` /yy+.           
+                                                  -+.oho.            
+                                                   o../+y            
+                                                  -s.-/:y:`          
+                                               .:o+-`--::oo/-`       
+                                            `/o+:.```---///oss+-     
+                                          .+o:.``...`-::-+++++sys-   
+                                         :y/```....``--::-yooooosh+  
+                                        -h-``--.```..-:-::ssssssssd+
+                                        h:``:.``....`--:-++hsssyyyym.
+                                       .d.`/.``--.```:--//odyyyyyyym/
+                                       `d.`+``:.```.--/-+/smyyhhhhhm:
+                                        os`./`/````/`-/:+oydhhhhhhdh`
+                                        `so.-/-:``./`.//osmddddddmd.
+                                          /s/-/:/.`/..+/ydmdddddmo`
+                                           `:oosso/:+/syNmddmdy/.
+                                               `-/++oosyso+/.`
+
+
+          ██████╗ ███████╗██████╗ ███████╗██████╗  ██████╗    ██╗███╗   ██╗███████╗██╗██████╗ ███████╗
+          ██╔══██╗██╔════╝██╔══██╗██╔════╝╚════██╗██╔════╝    ██║████╗  ██║██╔════╝██║██╔══██╗██╔════╝
+          ██║  ██║█████╗  ██║  ██║███████╗ █████╔╝██║         ██║██╔██╗ ██║███████╗██║██║  ██║█████╗
+          ██║  ██║██╔══╝  ██║  ██║╚════██║ ╚═══██╗██║         ██║██║╚██╗██║╚════██║██║██║  ██║██╔══╝
+          ██████╔╝███████╗██████╔╝███████║██████╔╝╚██████╗    ██║██║ ╚████║███████║██║██████╔╝███████╗
+          ╚═════╝ ╚══════╝╚═════╝ ╚══════╝╚═════╝  ╚═════╝    ╚═╝╚═╝  ╚═══╝╚══════╝╚═╝╚═════╝ ╚══════╝                                                          
 </pre>
 [![Build Status](https://travis-ci.org/DedSecInside/TorBot.svg?branch=dev)](https://travis-ci.org/DedSecInside/TorBoT)
 [![](https://img.shields.io/badge/Donate-Bitcoin-blue.svg?style=flat)](https://blockchain.info/address/14st7SzDbQZuu8fpQ74x477WoRJ7gpHFaj)
@@ -58,14 +87,14 @@ the following steps:
 ...(will be updated)
 
 ## Contribute
-Contributions to this project are always welcome. 
+Contributions to this project are always welcome.
 To add a new feature fork the dev branch and give a pull request when your new feature is tested and complete.
 If its a new module, it should be put inside the modules directory and imported to the main file.
 The branch name should be your new feature name in the format <Feature_featurename_version(optional)>. For example, <i>Feature_FasterCrawl_1.0</i>.
 Contributor name will be updated to the below list. :D
 
-## Dependencies 
-1. Tor 
+## Dependencies
+1. Tor
 2. Python 3.x (Make sure pip3 is installed)
 3. requests
 4. Beautiful Soup 4
@@ -83,11 +112,12 @@ Before you run the torBot make sure the following things are done properly:
 * Run tor service
 `sudo service tor start`
 
-* Make sure that your torrc is configured to SOCKS_PORT localhost:9050 
+* Make sure that your torrc is configured to SOCKS_PORT localhost:9050
 
 On Linux platforms, you can make an executable for TorBot by using the install.sh script.
 You will need to give the script the correct permissions using `chmod +x install.sh`
-Now you should have an executable file named torBot, run `./torBot` to execute the program. 
+Now you can run `./install.sh` to create the torBot binary.
+Run `./torBot` to execute the program. 
 
 An alternative way of running torBot is shown below, along with help instructions.
 
@@ -166,4 +196,3 @@ GNU Public License
 - [X] [robly78746](https://github.com/robly78746) - New Contributor
 
 ![](https://upload.wikimedia.org/wikipedia/commons/thumb/4/42/Opensource.svg/200px-Opensource.svg.png)
-
diff --git a/install.sh b/install.sh
@@ -1,5 +1,9 @@
 #!/bin/bash
 
+# Get Golang Dependencies
+go get github.com/mgutz/ansi
+go get golang.org/x/net/html
+
 # Makes directory for dependencies and executable to be installed
 mkdir -p tmp_build 
 mkdir -p tmp_dist

diff --git a/modules/go_linker.py b/modules/go_linker.py
@@ -0,0 +1,21 @@
+import sys
+
+from ctypes import cdll, c_char_p, c_longlong, c_int, Structure
+
+go_linker = cdll.LoadLibrary("modules/lib/go_get_urls.so")
+
+class GoString(Structure):
+    _fields_ = [("p", c_char_p), ("n", c_longlong)]
+
+go_linker.GetLinks.argtypes = [GoString, GoString, GoString, c_int]
+
+def GetLinks(url, addr, port, timeout):
+
+    url = url.encode('utf-8')
+    addr = addr.encode('utf-8')
+    port = str(port).encode('utf-8')
+
+    go_linker.GetLinks(GoString(url, len(url)),
+                      GoString(addr, len(addr)),
+                      GoString(port, len(port)),
+                      timeout)
diff --git a/modules/go_modules/getLinks.go b/modules/go_modules/getLinks.go
diff --git a/modules/go_modules/getLinks.py b/modules/go_modules/getLinks.py
diff --git a/modules/go_modules/goBot.so b/modules/go_modules/goBot.so
diff --git a/modules/lib/build.sh b/modules/lib/build.sh
@@ -0,0 +1,2 @@
+# Build script for .so file
+go build -o go_get_urls.so -buildmode=c-shared go_get_urls.go
diff --git a/modules/lib/go_dep.sh b/modules/lib/go_dep.sh
@@ -0,0 +1,3 @@
+# Download Golang dependencies 
+go get github.com/mgutz/ansi
+go get golang.org/x/net/html
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,2 @@
		# Build script for .so file
		go build -o go_get_urls.so -buildmode=c-shared go_get_urls.go