Block known phishing site and the endpoint it attempts to submit creds to.

See https://twitter.com/bentasker/status/1374396994194575368

We've added some code duplication in ADBLK-27 so move it to a function and make it DRY

de-dupe the blocked domain list

Pull down the Adguard CNAME tracker domains and process them into the blocked domain list for ADBLK-27

ADBLK-26 Block the OneTag distribution domains

ADBLK-25 Block domains associated with the CatapultTools Anti-Adblock Setup

ADBLK-24 Block Barclays analytics/metrics domains - it causes login page hangs

Block phising domain - observed in SMS mesdages trying to get user to enter creds at https://halifx-online.logon17.co.uk

Xiaomi seem to have started referencing an AWS ELB directly instead of using the domain they previously used. Block it

Add phishing domain - being used in phishing texts trying to get EE creds

Block the whiteops fingerprinting collection domains referenced here - https://smitop.com/post/reddit-whiteops/

Whitelist s.yimg when referenced from tw.mobi.yahoo.com

Implement ability to add specific whitelisting lines

Block ettoday ad domain for ADBLK-23

Block some specific Google Ad domains for ADBLK-23

Block Xiaomi's ELB

Block www.newzit.com/setABframe*

The URL https://www.newzit.com/setABframe.html gets embeded on the DailyMail and simply contains a call out to m-pulse.net (blocked elsewhere in these lists)

> <script>!function(e){var n="https://s.go-mpulse.net/boomerang/";if("False"=="True")e.BOOMR_config=e.BOOMR_config||{},e.BOOMR_config.PageParams=e.BOOMR_config.PageParams||{},e.BOOMR_config.PageParams.pci=!0,n="https://s2.go-mpulse.net/boomerang/"

My advice is still not to read the Daily Mail in the first place though

oops, remove the scheme

Block facebook tracker path

ADBLK-22 block fr.app.global.xiaomi.net and whatever variations they come up with for the third-level domain

Regex their Sesnsordata ones too

ADBLK-19 Add a new regex to handle Xiaomi's "resolver" service - knew there'd be another label appear at some point. This time it's "global" - {{resolver.msg.global.xiaomi.net}}

ADBLK-19 Use regex functionality to block some Xiaomi tracking domains

Update file header

Remove defunct link

ADBLK-21 Update index page to include Pihole information

ADBLK-21 add script to pull down and consume the regex list

ADBLK-21 Expose a Regex list to be consumed by PiHole

ADBLK-19 some of the region specific Miui tracking domains

Move domain to correct file

ADBLK-19 Block the zones ad.[locations] for Xiaomi

ADBLK-20 Update build_abp to use the new block files

ADBLK-20 Remove errant semicolon and add a `do`

Move old blockfile out of the way (keeping so that can still git blame to see when/why a domain was added)

ADBLK-20 Split manualblocks out into seperate files so that individual companies can be spotted/updated easily

There's an invalid domain in one of the upstream lists, correct it. #2

Should come up with better handling for this really

ADBLK-19 Upstream list seems to be missing the russian endpoint. See https://twitter.com/craiu/status/1256508158161367040

ADBLK-19 Consume the excellent Xiaomi domain list - https://gist.githubusercontent.com/unknownFalleN/3f38e2daa8a98caff1b0d965c2b89b25/raw - when building lists

ADBLK-19 Block some more Xiaomi domains

ADBLK-19 Block Xiaomi's SensorData domain

Make the domain wide ones just specify domain

ADBLK-18 Create a pihole compatible list with the social media domains re-inserted

Add link to new list

Oops, give him his tag back

ADBLK-18 Move social media trackers into new config file - `social_media_trackers.txt`

ADBLK-18 Adjust deployment script to seperate social media trackers out (they'll need moving to a different config file)

Does 3 new things

* Creates `social_media_trackers.txt` - an ABP compatible list containing just SM tracker domains
* Creates `adblock_compiled_no_sm.txt` - an ABP compatible copy of `adblock_compiled.txt` SM tracker domains excluded
* Creates `easylist_modified_no_sm.txt` - An ABP compatible copy of `easylist_modified.txt` with the SM tracker domains excluded

guce.advertising.com is used to try and inject 1st party tracking cookies rather than being a 3rd party

You follow a link which takes you to guce.advertising.com, that sets a cookie and then redirects you to the actual page.

This update will break following some links as a result

Reblock the Admiral Anti-block domains

Treating these as zones breaks pihole's regex matches. Needs to be added as an explicit block instead
Revert "Update the Admiral lists"

This reverts commit 5339a2b9c68405a3a24b17b3159f1ddd8b993f76.

Update the Admiral lists

Pulled down with:

$ curl https://raw.githubusercontent.com/jkrejcha/AdmiraList/master/AdmiraList.txt | tee -a config/manualzones.txt

Remove the admiral urls added in d98d406c4f5d38ce72e4cca679e27190148d3777

They'll be replaced with an updated list in a minute

pubexchange are a paid advertising network

ADBLK-17 block *.getadmiral.com

ADBLK-17 Block a new admiral anti-adblock domain

ADBLK-16 Block push notifier pushassist.com

Block MOL Anti-Adblock script

Block some Piano.io related tracker domains. ADBLK-15

Block Ecosia's analytics (identified in MISC-35)

Analytics used by webbroadcast

ADBLK-14 Block zone amobee.com

They own zone Konterra.com which is already blocked upstream, and have been implicated in DataSpii.

It *looks* like they were probably a consumer of Nacho Analytics data rather than being involved in collection of data from end users, but as their business is tracking they're being blocked anyway

ADBLK-14 Block DDMR.com

Although the zone is blocked, lets be literal and block the exact label too. pnldsk.adclarity.com also comes under ADBLK-14

ADBLK-14 Block list of domains know to be data ingest points for the extensions involved in DataSpii

Blocking 2 domains tied up in DataSpii.

Domain pnldsk.adclarity.com CNAMEs into adcint.net

https://arstechnica.com/information-technology/2019/07/dataspii-inside-the-debacle-that-dished-private-data-from-apple-tesla-blue-origin-and-4m-people/

Block another 2o7 domain - used by Archant for the EADT - archanteadt.112.2o7.net

ADBLK-13 Block Grapeshot related domains

Grapeshot is an analytics/tracking/"customer engagement" system

They appear to use a subdomain per customer, so block the entire zone - does mean their www goes inaccessible, but it's fairly minor as collateral damage goes

ADBLK-12 Generate a plaintext list of blocked zones - push into output file `blockedzones.txt`

ADBLK-10 Block auto.search.msn.com and 2mdn.net

Move AMP Project from manualblock to manualpages.

The reason being, that domains in manualblock get included in the blocklist consumed by dns.bentasker.co.uk

Whilst I hate AMP, and want it blocked, seems unfair to block anyone using my DNS service from using it.

ADBLK-9 Block a couple of endpoints the Google News makes XHR requests to when it believes the client is an Android phone.

Publish v1.4.3 of the anti-amp script

Forgot to link to blockeddomains from the homepage

To be honest, if you're reading The Sun you've already got bigger problems than ads, but block them all the same

sdad.guru seems to be used to collect metrics from various sites including

- msn.com
- slickdeals.net
- www.trustedreview.net
- sfgate.com

URL observed from msn.com: https://www.sdad.guru/i10c@p1/cenome/endpoint/nanovisor?inp=www.msn.com&env.app=nanovisor&env.appVersion=10.6.37&env.instance=morpheus

- The bare domain points at a GoDaddy domain parking page.
- Attempts to connect to the document root of www.sdad.guru results in the server tearing down the connection.

Combined, that's sufficiently suspicious to warrant a block without beautifying the JS it's serving.

Block the Bing RewardsApp activity tracker - most people aren't using Bing Rewards

ADBLK-8 Adding example script for pulling zones (only) into unbound

My DNS server has a read-only root partition (with a writeable /var), so my deployment using this went as follows:

```
mkdir /var/unbound_blocks
cd /etc/unbound/local.d
mount -o remount,rw /
ln -s /var/unbound_blocks/ adblocks

cd /var/unbound_blocks/
nano unbound_block_zones.sh # Following this commit, should just be able to wget it
chmod +x unbound_block_zones.sh
./unbound_block_zones.sh

cd /etc/unbound/
nano unbound.conf
service unbound reload

echo "15 * * * * root cd /var/unbound_blocks/; ./unbound_block_zones.sh" > /etc/cron.d/update_adblock_zones

mount -o remount,ro /

```

ADBLK-8 Create unbound format file containing only manually blocked zones

NOOP, whitespace tweaks to make it more readable (didn't help much...)

Will do better later

Oops, wrong file

ADBLK-3 Explicitly block the CNAME targets too, again for pi-hole's benefit

ADBLK-3 Explicitly include swa.and.co.uk in the manualblock so that it makes it into pi-hole (pity Gravity lists can't be wildcarded)

Block Dailymail / DMG analytics domains

Block swa.metro.co.uk

This domain is identical in behaviour to the domain blocked in ADBLK-3

{noformat}ben@milleniumfalcon:~/Documents/src.old/adblock_lists$ host swa.metro.co.uk
swa.metro.co.uk is an alias for metro.co.uk.102.122.2o7.net.
metro.co.uk.102.122.2o7.net has address 130.248.129.181
{noformat}

Also explicitly blocking the zone {{2o7.net}} so that Pi-Hole's consuming my lists should stop resolving anything that's cnamed out to 2o7.net

ADBLK-6 Block the Pushly distribution zone p-n.io

Pushly allows sites to push notifications to your browser - something I neither need nor want - and as a result get to see a reasonable chunk of your browsing history (at least amongst news sites)

ADBLK-5 Block dmgmediaprivacy.co.uk

It's a zone run by the Daily Mail's owners, and despite the name "mediaprivacy" appears to be being used to serve ads

ADBLK-4 block a bunch of userreport tracking domains

Block *.and.co.uk - see ADBLK-3

ADBLK-2 Block HMRCMECLAIM.com

It's a phishing domain (they just sent me a SMS).

Also reported to Phishtank - https://www.phishtank.com/phish_detail.php?phish_id=6065854

npttech don't have any content on their base domain, and appear to serve up anti-adblock scripts (e.g. https://www.npttech.com/advertising.js)

Add a copy of the alpha release v1.4.1a - https://github.com/bentasker/RemoveAMP/releases/tag/v1.4.1a

Users should not use this unless specifically advised to do so.

Add v1.4 of the anti-AMP script

Block a Miui tracking domain

Create a list of domains for simple inclusion into pihole

Adding a reference download script

Remove quad A from redirects, unbound doesn't like them

Reduce the risk of duplicates when building autolist.txt

These are used for GDPR consent banners.

The thing is, to maintain their log of what you consented to they have to submit some data, and I don't particularly want that recorded either

ADBLK-1 Block another Admiral domain - forecasttiger.com

ADBLK-1 Block another Admiral Anti-Adblock domain

Block zone aaxads.com

Privacy badger flagged it on reddit earlier (c.aaxads.com in this case).