Skip to content

Commit 0511ca4

Browse files
author
crazy-max
committed
Add Windows 7 and Windows 8.1 hosts and firewall rules (Issue #1)
Add Wireshark script to extract log and generate CSV (Issue #6) Bug spy rule blocking Windows update (Issue #14) Add diff script to compare current firewall rules / hosts with generated CSVs New hosts and firewall rules
1 parent a76761b commit 0511ca4

File tree

102 files changed

+52488
-32722
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

102 files changed

+52488
-32722
lines changed

CHANGELOG.md

+8
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,13 @@
11
# Changelog
22

3+
## 3.1 (2016/06/07)
4+
5+
* Add Windows 7 and Windows 8.1 hosts and firewall rules (Issue #1)
6+
* Add Wireshark script to extract log and generate CSV (Issue #6)
7+
* Bug spy rule blocking Windows update (Issue #14)
8+
* Add diff script to compare current firewall rules / hosts with generated CSVs
9+
* New hosts and firewall rules
10+
311
## 3.0 (2016/06/03)
412

513
* Add Sysmon, Proxifier, Wireshark capture method in the [Wiki](../../wiki) (Issue #11)

README.md

+57-21
Original file line numberDiff line numberDiff line change
@@ -8,13 +8,15 @@
88

99
- [About](#about)
1010
- [How ?](#how-)
11-
- [Requirements](#requirements)
1211
- [Usage](#usage)
13-
- [Hosts](#hosts)
14-
- [Firewall](#firewall)
15-
- [NCSI (Network Connectivity Status Indicator)](#ncsi-network-connectivity-status-indicator)
16-
- [DNSCrypt](#dnscrypt)
17-
- [Proxifier](#proxifier)
12+
- [Data](#data)
13+
- [Hosts](#hosts)
14+
- [Firewall](#firewall)
15+
- [NCSI (Network Connectivity Status Indicator)](#ncsi-network-connectivity-status-indicator)
16+
- [DNSCrypt](#dnscrypt)
17+
- [Proxifier](#proxifier)
18+
- [Logs](#logs)
19+
- [Scripts](#scripts)
1820
- [Projects using WindowsSpyBlocker](#projects-using-windowsspyblocker)
1921
- [License](#license)
2022

@@ -27,53 +29,69 @@ To be notified of new releases you can subscribe to this [Atom feed](https://git
2729

2830
## How ?
2931

30-
I use a QEMU virtual machine on the server virtualization management platform [Proxmox VE](https://www.proxmox.com/en/) based on Windows 10 Pro 64bits with automatic updates enabled.<br />
31-
I clean traffic dumps every day and compare results with the current rules to add / remove some hosts or firewall rules (need to automate the process...).
32+
I use a QEMU virtual machines on the server virtualization management platform [Proxmox VE](https://www.proxmox.com/en/) based on :
33+
34+
* Windows 10 Pro 64bits with automatic updates enabled.
35+
* Windows 8.1 Pro 64bits with automatic updates enabled.
36+
* Windows 7 SP1 Pro 64bits with automatic updates enabled.
37+
38+
I clean traffic dumps every day and compare results with the current rules to add / remove some hosts or firewall rules.
3239

3340
Tools used to capture traffic :
3441
* **qemu -net dump** : capture
3542
* **[Wireshark](../../wiki/captureWireshark)** : capture + logs
3643
* **[Sysmon](../../wiki/captureSysmon)** : capture + logs
3744
* **[Proxifier](../../wiki/captureProxifier)** : logs
3845

39-
All traffic logs are available in the `logs` folder.
40-
41-
## Requirements
42-
43-
* Scripts required [Visual C++ Redistributable for Visual Studio 2012](https://www.microsoft.com/en-us/download/details.aspx?id=30679) (vcredist_x86.exe).
46+
All traffic events are available in the [logs](#logs) folder.
4447

4548
## Usage
4649

50+
### Data
51+
52+
`data` is the master folder of this project. It contains the blocking rules based on domain names or IPs addresses detected during the capture process.
4753
* `data/<type>/winX/spy.txt` : Block Windows Spy / Telemetry
4854
* `data/<type>/winX/update.txt` : Block Windows Update
4955
* `data/<type>/winX/extra.txt` : Block third party applications
5056

51-
### Hosts
57+
#### Hosts
5258

5359
Copy / paste the content of the files in `data/hosts` in your Windows hosts file located in `C:\Windows\System32\drivers\etc\hosts`.<br />
5460

5561
You can use the [HostsMan](http://www.abelhadigital.com/hostsman) freeware to keep update your hosts file.<br />
5662
I have created a git hook to publish the hosts files to my personal website :
63+
64+
##### Windows 7
65+
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win7/spy.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win7/spy.txt)
66+
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win7/update.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win7/update.txt)
67+
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win7/extra.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win7/extra.txt)
68+
69+
##### Windows 8.1
70+
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win81/spy.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win81/spy.txt)
71+
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win81/update.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win81/update.txt)
72+
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win81/extra.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win81/extra.txt)
73+
74+
##### Windows 10
5775
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win10/spy.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win10/spy.txt)
5876
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win10/update.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win10/update.txt)
5977
* [http://www.crazyws.fr/WindowsSpyBlocker/hosts/win10/extra.txt](http://www.crazyws.fr/WindowsSpyBlocker/hosts/win10/extra.txt)
6078

61-
### Firewall
79+
#### Firewall
6280

6381
Some queries use IP addresses but you can stop them with your Firewall.<br />
64-
All relative information about these IP addresses are listed in the CSV files `firewall-` in the [logs folder](tree/master/firewall/logs).<br />
82+
All relative information about these IP addresses are listed in the CSV files `firewall-` in the [logs folder](firewall/logs).<br />
6583
To add / remove firewall rules or test IPs, read the instructions in [scripts/firewall folder](scripts/firewall).
6684

67-
### NCSI (Network Connectivity Status Indicator)
85+
#### NCSI (Network Connectivity Status Indicator)
6886

6987
Windows check a Microsoft site for connectivity, using the Network Connectivity Status Indicator site.<br />
7088
NCSI performs a DNS lookup on `www.msftncsi.com` and sends a DNS lookup request for `dns.msftncsi.com`.<br />
71-
You can block this probe by adding the content of the `windowsX_extra.txt` hosts file.<br />
89+
You can block this probe by adding the content of the `data/<type>/winX/extra.txt` hosts file.<br />
7290

7391
But you will have a ["No Internet access" warning in your system tray](../../wiki/FAQ#no-internet-access-on-my-network-card).<br />
74-
To solve this problem read the instructions in [scripts/ncsi folder](scripts/ncsi).
92+
To solve this problem you can use the alternative WindowsSpyBlcoker NCSI. Read the instructions in [scripts/ncsi folder](scripts/ncsi).
7593

76-
### DNSCrypt
94+
#### DNSCrypt
7795

7896
[DNSCrypt](https://dnscrypt.org/) is a protocol for securing communications between a client and a DNS resolver. With this tool you can blacklist some domains with the plugin [libdcplugin_example_ldns_blocking](https://github.com/jedisct1/dnscrypt-proxy#plugins) and add domains with leading and trailing wildcards.<br />
7997
To install DNSCrypt on Windows, read the [README-WINDOWS](https://github.com/jedisct1/dnscrypt-proxy/blob/master/README-WINDOWS.markdown) on the official GitHub repository.<br />
@@ -85,18 +103,36 @@ dnscrypt-proxy -R <name> --plugin=libdcplugin_example_ldns_blocking.dll,--domain
85103

86104
Replace `<name>` with a [public DNS resolvers supporting DNSCrypt](https://github.com/jedisct1/dnscrypt-proxy/blob/master/dnscrypt-resolvers.csv) you want to use. Note its name, in the first column (for example: `dnscrypt.org-fr`).
87105

88-
### Proxifier
106+
#### Proxifier
89107

90108
Some hosts are not blocked and required a top level application.<br />
91109
For example you can use [Proxifier](https://www.proxifier.com/) software to block Microsoft spy.<br />
92110
Copy the content of the proxifier files in `data/proxifier` in a blocked rule :
93111

94112
![](../../wiki/img/proxifierRules-20160516.png)
95113

114+
### Logs
115+
116+
Logs of tools used to capture traffic and resolution of firewall rules in CSV format available in the [logs folder](firewall/logs).
117+
* `*-all.csv` : all events
118+
* `*-hosts-count.csv` : number of events per host
119+
* `*-unique.csv` : first trigger of an event per host / process / destination port
120+
121+
### Scripts
122+
123+
Several scripts are used to ease implementation of rules and contribution. To use these scripts you have to download and install the [Visual C++ Redistributable for Visual Studio 2012](https://www.microsoft.com/en-us/download/details.aspx?id=30679) (vcredist_x86.exe).
124+
* `diff.bat` : Generate a diff log based on CSV logs and data for Sysmon, Proxifier and Wireshark.
125+
* `firewall.bat` : Add / remove rules and resolve IPs adresses
126+
* `ncsi.bat` : Apply an alternate NCSI and test your internet connection the Micrososft way. More info on the [FAQ Wiki page](../../wiki/FAQ#what-is-ncsi-).
127+
* `proxifier.bat` : Extract events from log and generate CSV files. More info on the [Proxifier Wiki page](../../wiki/captureProxifier)
128+
* `sysmon.bat` : Install / uninstall Sysmon and extract events log then generate CSV files. More info on the [Sysmon Wiki page](../../wiki/captureSysmon)
129+
* `wireshark.bat` : Extract events log then generate CSV files based on IPv4 hosts. More info on the [Wireshark Wiki page](../../wiki/captureWireshark)
130+
96131
## Projects using WindowsSpyBlocker
97132

98133
* [pi-hole](https://pi-hole.net/) : A black hole for Internet advertisements (designed for Raspberry Pi).
99134
* [StopAd](http://stopad.generate.club/) : Service for MikroTik routers made to block "advertising" and more.
135+
* [OpenWrt adblock package](https://github.com/openwrt/packages/tree/master/net/adblock/files) : DNS based ad/abuse domain blocking
100136

101137
## License
102138

data/dnscrypt/win10/extra.txt

+10-15
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,19 @@
11
*.2mdn.net
2-
2mdn.net
32
*.akamaitechnologies.com
4-
akamaitechnologies.com
53
apps.skype.com
6-
*.bing.net
7-
bing.net
8-
*.hotmail.com
9-
hotmail.com
10-
*.live.com
11-
live.com
12-
*.live.net
13-
live.net
4+
cdn.content.prod.cms.msn.com
5+
choice.microsoft.com.nstac.net
6+
client.wns.windows.com
7+
dmd.metaservices.microsoft.com
8+
img-s-msn-com.akamaized.net
9+
licensing.mp.microsoft.com
10+
*.messenger.live.com
1411
*.msftncsi.com
15-
msftncsi.com
16-
*.msn.com
17-
msn.com
1812
oneclient.sfx.ms
1913
pricelist.skype.com
14+
search.msn.com
15+
tk2.plt.msn.com
2016
ui.skype.com
17+
view.atdmt.com
2118
*.weather.microsoft.com
22-
weather.microsoft.com
2319
*.xboxlive.com
24-
xboxlive.com

data/dnscrypt/win10/spy.txt

+50-37
Original file line numberDiff line numberDiff line change
@@ -1,62 +1,75 @@
11
*.a-msedge.net
2-
a-msedge.net
2+
*.ads*.msn.com
3+
*.ads*.msads.net
4+
ac3.msn.com
35
*.adnexus.net
4-
adnexus.net
56
*.adnxs.com
6-
adnxs.com
7-
*.adtech.de
8-
adtech.de
9-
lb1.www.ms.akadns.net
10-
schemas.microsoft.akadns.net
7+
*.ams*.msecn.net
118
*.atdmt.com
12-
atdmt.com
13-
compatexchange.cloudapp.net
14-
secure.flashtalking.com
15-
pre.footprintpredict.com
16-
clients2.google.com
17-
version.hybrid.api.here.com
9+
aka-cdn-ns.adtech.de
1810
answers.microsoft.com
1911
bingads.microsoft.com
12+
bs.serving-sys.com
13+
c.msn.com
14+
cache.datamart.windows.com
2015
choice.microsoft.com
16+
choice.microsoft.com.nsatc.net
17+
compatexchange.cloudapp.net
18+
compatexchange1.trafficmanager.net
2119
corp.sts.microsoft.com
22-
corpext.msitadfs.glbdns2.microsoft.com
20+
cs1.wpc.v0cdn.net
21+
db3wns2011111.wns.windows.com
22+
db5sch101101939.wns.windows.com
23+
db5sch103082111.wns.windows.com
2324
diagnostics.support.microsoft.com
2425
displaycatalog.mp.microsoft.com
25-
fe3.delivery.dsp.mp.microsoft.com.nsatc.net
26+
eu.vortex.data.microsoft.com
27+
feedback.microsoft-hohm.com
2628
feedback.search.microsoft.com
29+
feedback.windows.com
30+
flex.msn.com
31+
g.msn.com
2732
geover-prod.do.dsp.mp.microsoft.com
28-
i1.services.social.microsoft.com
33+
*.glbdns2.microsoft.com
34+
h1.msn.com
35+
h2.msn.com
36+
lb1.www.ms.akadns.net
37+
*.location.live.net
38+
m.adnxs.com
39+
m.hotmail.com
40+
*.msedge.net
41+
msntest.serving-sys.com
2942
officeclient.microsoft.com
43+
onesettings-*.metron.live.com.nsatc.net
44+
pre.footprintpredict.com
45+
preview.msn.com
46+
*.rad.live.com
47+
*.rad.msn.com
48+
*.rads.msn.com
3049
redir.metaservices.microsoft.com
50+
schemas.microsoft.akadns.net
51+
secure.flashtalking.com
52+
*.services.social.microsoft.com
3153
settings-sandbox.data.microsoft.com
3254
settings-win.data.microsoft.com
3355
settings.data.microsoft.com
3456
spynet2.microsoft.com
3557
spynetalt.microsoft.com
58+
ssw.live.com
3659
statsfe1.ws.microsoft.com
3760
statsfe2.ws.microsoft.com
3861
survey.watson.microsoft.com
39-
telemetry.microsoft.com
62+
*.telemetry.appex.bing.net
4063
*.telemetry.microsoft.com
41-
telemetry.urs.microsoft.com
42-
v10.vortex-win.data.microsoft.com
43-
vortex-sandbox.data.microsoft.com
44-
vortex-win.data.microsoft.com
45-
*.vortex.data.microsoft.com
46-
vortex.data.microsoft.com
47-
*.watson.microsoft.com
64+
*.telemetry.microsoft.com.nsatc.net
65+
*.telemetry.urs.microsoft.com
66+
tsfe.trafficshaping.dsp.mp.microsoft.com
67+
version.hybrid.api.here.com
68+
*.virtualearth.net
69+
*.vo.msecnd.net
70+
*.vortex*.data.microsoft.com
71+
*.vortex*.data.metron.live.com.nsatc.net
72+
vortex-*.metron.live.com.nsatc.net
73+
watson.live.com
4874
watson.microsoft.com
4975
win10.ipv6.microsoft.com
50-
feedback.microsoft-hohm.com
51-
*.msads.net
52-
msads.net
53-
vo.msecnd.net
54-
*.serving-sys.com
55-
serving-sys.com
56-
apps.skype.com
57-
cs1.wpc.v0cdn.net
58-
*.virtualearth.net
59-
virtualearth.net
60-
datamart.windows.com
61-
db3wns2011111.wns.windows.com
62-
feedback.windows.com

data/dnscrypt/win10/update.txt

+3-2
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
1+
*.delivery.dsp.mp.microsoft.com.nsatc.net
2+
*.delivery.mp.microsoft.com
13
*.windowsupdate.com
2-
windowsupdate.com
34
*.update.microsoft.com
4-
update.microsoft.com
5+
*.update.microsoft.com.akadns.net

data/dnscrypt/win7/extra.txt

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
crl.microsoft.com
2+
dmd.metaservices.microsoft.com
3+
g.bing.com
4+
*.msftncsi.com
5+
time.windows.com
6+
wscont.apps.microsoft.com
7+
wscont.apps.microsoft.com.edgesuite.net

data/dnscrypt/win7/spy.txt

+9
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
compatexchange1.trafficmanager.net
2+
crl.microsoft.com
3+
eu.vortex.data.microsoft.com
4+
settings-win.data.microsoft.com
5+
spynet2.microsoft.com
6+
*.telemetry.microsoft.com
7+
teredo.ipv6.microsoft.com
8+
*.vortex*.data.microsoft.com
9+
watson.microsoft.com

data/dnscrypt/win7/update.txt

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
download.microsoft.com
2+
*.update.microsoft.com
3+
*.windowsupdate.com

data/dnscrypt/win81/extra.txt

+18
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
activation-v2.sls.microsoft.com
2+
appex-rf.msn.com
3+
dmd.metaservices.microsoft.com
4+
g.bing.com
5+
img.stb.s-msn.com
6+
login.live.com
7+
*.msftncsi.com
8+
next-services.apps.microsoft.com
9+
*.services.appex.bing.com
10+
*.smartscreen.microsoft.com
11+
*.tile.appex.bing.com
12+
validation-v2.sls.microsoft.com
13+
watson.telemetry.microsoft.com
14+
*.weather.microsoft.com
15+
wscont.apps.microsoft.com
16+
wscont.apps.microsoft.com.edgesuite.net
17+
wscont1.apps.microsoft.com
18+
wscont2.apps.microsoft.com

data/dnscrypt/win81/spy.txt

+10
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
*.a-msedge.net
2+
settings-win.data.microsoft.com
3+
spynet2.microsoft.com
4+
spynetalt.microsoft.com
5+
statsfe2.update.microsoft.com
6+
statsfe2.ws.microsoft.com
7+
*.telemetry.microsoft.com
8+
*.trafficmanager.net
9+
*.vortex.data.microsoft.com
10+
vortex-win.data.microsoft.com

data/dnscrypt/win81/update.txt

+10
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
bg.v4.a.dl.ws.microsoft.com
2+
bg.v4.emdl.ws.microsoft.com
3+
bg1.v4.a.dl.ws.microsoft.com
4+
bg1.v4.emdl.ws.microsoft.com
5+
bg5.v4.a.dl.ws.microsoft.com
6+
bg5.v4.emdl.ws.microsoft.com
7+
fe2.ws.microsoft.com
8+
fg.v4.download.windowsupdate.com
9+
*.update.microsoft.com
10+
*.windowsupdate.com

data/firewall/win10/extra.txt

+9
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,17 @@
33

44
65.52.100.11
55
65.52.100.93
6+
191.232.139.2
7+
191.232.139.7
8+
191.232.139.49
9+
191.232.139.56
10+
191.232.139.141
11+
191.232.139.170
12+
191.232.139.182
613
191.232.139.253
14+
207.46.194.14
715
207.46.194.25
16+
207.46.194.33
817
207.46.223.94
918
207.68.166.254
1019
213.198.96.195

0 commit comments

Comments
 (0)