Page 10 of 65 FirstFirst ... 891011122060 ... LastLast
Results 91 to 100 of 650

Thread: General MoBlock thread

  1. #91
    Join Date
    Aug 2008
    Location
    Brazil
    Beans
    12,497
    Distro
    Ubuntu Studio 12.04 Precise Pangolin

    Re: General MoBlock thread

    Quote Originally Posted by jre View Post
    Thanks, lovinglinux, for this information - I totally missed that. Although the level1 is not empty here.
    You are welcome. Level 1 is ok now, but it was empty when I wrote the previous post

    Quote Originally Posted by jre View Post
    If you want to use that blocklists try a "moblock-control update" or download it manually. Then place the blocklist in /var/spool/moblock-control/used. (e.g. "sudo cp level1.gz /var/spool/moblock-control/used")
    I couldn't find /var/spool/moblock-control/used but I have found /var/spool/moblock/used and mobloquer is updating to this directory. Does this means that the new moblock-control package wasn't properly installed or is just the path configured in mobloquer settings?

    Anyway, I have created a script to download Bluetack's lists from an alternative source and move them to /var/spool/moblock/used directory, so moblock can be loaded properly. This do not require any changes in moblock lists.

    Code:
    #!/bin/bash
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/ads-trackers-and-bad-pr0n.gz http://list.iblocklist.com/?list=bt_ads
    sudo mv ~/Desktop/ads-trackers-and-bad-pr0n.gz /var/spool/moblock/used/ads-trackers-and-bad-pr0n.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/Microsoft.gz http://list.iblocklist.com/?list=bt_microsoft
    sudo mv ~/Desktop/Microsoft.gz /var/spool/moblock/used/Microsoft.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/bogon.gz http://list.iblocklist.com/?list=bt_bogon
    sudo mv ~/Desktop/bogon.gz /var/spool/moblock/used/bogon.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/dshield.gz http://list.iblocklist.com/?list=bt_dshield
    sudo mv ~/Desktop/dshield.gz /var/spool/moblock/used/dshield.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/edu.gz http://list.iblocklist.com/?list=bt_edu
    sudo mv ~/Desktop/edu.gz /var/spool/moblock/used/edu.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/hijacked.gz http://list.iblocklist.com/?list=bt_hijacked
    sudo mv ~/Desktop/hijacked.gz /var/spool/moblock/used/hijacked.gz
    
    #wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/iana-multicast.gz http://www.bluetack.co.uk/config/iana-multicast.gz
    #sudo mv ~/Desktop/iana-multicast.gz /var/spool/moblock/used/iana-multicast.gz
    
    #wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/iana-private.gz http://www.bluetack.co.uk/config/iana-private.gz
    #sudo mv ~/Desktop/iana-private.gz /var/spool/moblock/used/iana-private.gz
    
    #wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/iana-reserved.gz http://www.bluetack.co.uk/config/iana-reserved.gz
    #sudo mv ~/Desktop/iana-reserved.gz /var/spool/moblock/used/iana-reserved.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/level1.gz http://list.iblocklist.com/?list=bt_level1
    sudo mv ~/Desktop/level1.gz /var/spool/moblock/used/level1.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/level2.gz http://list.iblocklist.com/?list=bt_level2
    sudo mv ~/Desktop/level2.gz /var/spool/moblock/used/level2.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/level3.gz http://list.iblocklist.com/?list=bt_level3
    sudo mv ~/Desktop/level3.gz /var/spool/moblock/used/level3.gz
    
    #wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/fornonlancomputers.gz http://www.bluetack.co.uk/config/fornonlancomputers.gz
    #sudo mv ~/Desktop/fornonlancomputers.gz /var/spool/moblock/used/fornonlancomputers.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/proxy.gz http://list.iblocklist.com/?list=bt_proxy
    sudo mv ~/Desktop/proxy.gz /var/spool/moblock/used/proxy.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/rangetest.gz http://list.iblocklist.com/?list=bt_rangetest
    sudo mv ~/Desktop/rangetest.gz /var/spool/moblock/used/rangetest.gz
               
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/spyware.gz http://list.iblocklist.com/?list=bt_spyware
    sudo mv ~/Desktop/spyware.gz /var/spool/moblock/used/spyware.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/spider.gz http://list.iblocklist.com/?list=bt_spider
    sudo mv ~/Desktop/spider.gz /var/spool/moblock/used/spider.gz
    
    wget --timeout=30 --tries=3 --timestamping --no-directories -O ~/Desktop/templist.gz http://list.iblocklist.com/?list=bt_templist
    sudo mv ~/Desktop/templist.gz /var/spool/moblock/used/templist.gz
    Don't forget to remove or comment the lines of lists that you don't use.

    This must be run through Terminal, because it will prompt for sudo password.

    There is probably a more elegant way of doing this, but I'm still a Linux newbie . I hope this will help people experiencing issues updating bluetack's lists.
    Last edited by lovinglinux; September 28th, 2008 at 01:50 PM.

  2. #92
    Join Date
    Jan 2007
    Beans
    762

    Re: General MoBlock thread

    Quote Originally Posted by lovinglinux View Post
    I couldn't find /var/spool/moblock-control/used but I have found /var/spool/moblock/used and mobloquer is updating to this directory. Does this means that the new moblock-control package wasn't properly installed or is just the path configured in mobloquer settings?
    No, this simply means that I should think while typing. The path is, and has been, /var/spool/moblock/used
    Sorry, for the confusion, I'll correct that in my post.

    The script that you have should work, but that is nearly the same as what happens on "moblock-control update". IMHO the problem is on bluetack's side, all that we can do is try several times (either with your script or with "moblock-control update") or wait - or change the lists that we use.

    Hehe, I started moblock-control with writing similar things as you are doing now Happy coding!
    Please post your logfiles and output of commands wrapped in code tags:
    Code:
    [code]output[/code]
    Co-author of PeerGuardian Linux (pgl). Maintainer of the pgl package repositories for Debian and Ubuntu.

  3. #93
    Join Date
    Aug 2008
    Location
    Brazil
    Beans
    12,497
    Distro
    Ubuntu Studio 12.04 Precise Pangolin

    Re: General MoBlock thread

    Quote Originally Posted by jre View Post
    No, this simply means that I should think while typing. The path is, and has been, /var/spool/moblock/used
    Sorry, for the confusion, I'll correct that in my post.
    No problem.

    Quote Originally Posted by jre View Post
    The script that you have should work, but that is nearly the same as what happens on "moblock-control update". IMHO the problem is on bluetack's side, all that we can do is try several times (either with your script or with "moblock-control update") or wait - or change the lists that we use.
    Not really. While I imagine the process should be similar, the script I wrote uses a mirror, so this could solve the problem temporarily without the need for changing lists sources. So, it's a single-click fast solution. I'm not really sure when or how they sync the lists with bluetack site, but I'm pretty sure the files are hosted on another domain. I even had to rename the files with the script, because they put a "bt_" prefix in front of most of the gz files.

    Quote Originally Posted by jre View Post
    IMHO the problem is on bluetack's side...
    I agree. If I didn't use a different source, the script wouldn't help much.

    Quote Originally Posted by jre View Post
    Hehe, I started moblock-control with writing similar things as you are doing now Happy coding!
    Hehe, this thing is addictive. Before moving to Linux I had something against the command line approach, but now I can see how good it is. The problem is that I'm starting to spend more time imagining how I could the make the computer do things I want and the way I want than actually using it

  4. #94
    Join Date
    Jan 2007
    Beans
    762

    Re: General MoBlock thread

    Quote Originally Posted by lovinglinux View Post
    Not really. While I imagine the process should be similar, the script I wrote uses a mirror, so this could solve the problem temporarily without the need for changing lists sources. So, it's a single-click fast solution. I'm not really sure when or how they sync the lists with bluetack site, but I'm pretty sure the files are hosted on another domain. I even had to rename the files with the script, because they put a "bt_" prefix in front of most of the gz files.
    Oh! Yes, now I see you're using iblocklist. I just scanned the source but didn't really look at the URLs

    This is one of the biggest TODOs left: supporting php redirects so that iblocklist can be used with moblock-control.
    Please post your logfiles and output of commands wrapped in code tags:
    Code:
    [code]output[/code]
    Co-author of PeerGuardian Linux (pgl). Maintainer of the pgl package repositories for Debian and Ubuntu.

  5. #95
    Join Date
    Aug 2008
    Location
    Brazil
    Beans
    12,497
    Distro
    Ubuntu Studio 12.04 Precise Pangolin

    Re: General MoBlock thread

    Quote Originally Posted by jre View Post
    This is one of the biggest TODOs left: supporting php redirects so that iblocklist can be used with moblock-control.
    That would be great.

    I have a new question.

    I'm only using local lists. I download several lists using the script and merge them using TinyBLM. Nevertheless, do I need to run the update in mobloquer whenever I change my local lists or hitting "Reload' will be enough to get the latest local lists? I'm asking this because I was updating until today, when I got the same issue posted by chronniff. The weird thing is that I'm not using any bluetacks's lists but moblock keeps trying to connect to the site and get stuck in the middle of the process.

  6. #96
    Join Date
    Jan 2007
    Beans
    762

    Re: General MoBlock thread

    Quote Originally Posted by lovinglinux View Post
    That would be great.

    I have a new question.

    I'm only using local lists. I download several lists using the script and merge them using TinyBLM. Nevertheless, do I need to run the update in mobloquer whenever I change my local lists or hitting "Reload' will be enough to get the latest local lists? I'm asking this because I was updating until today, when I got the same issue posted by chronniff. The weird thing is that I'm not using any bluetacks's lists but moblock keeps trying to connect to the site and get stuck in the middle of the process.
    "reload" is good for you. Then all lists configured in blocklists.list will be unpacked and cat'ted together to the master blocklist /etc/moblock/guarding.p2p. Since you are only using local lsits there's no need to do a "update".
    When you do an "update", moblock-control tries to connect to bluetack first to test if network access is available. I might use another TESTHOST than bluetack.co.uk, or perhaps check this with a more sophisticated way. Currently it's simply downloading bluetack's index.html ...
    So I guess you got an "Error 171: No connection to www.bluetack.co.uk. Aborting!", right?
    Please post your logfiles and output of commands wrapped in code tags:
    Code:
    [code]output[/code]
    Co-author of PeerGuardian Linux (pgl). Maintainer of the pgl package repositories for Debian and Ubuntu.

  7. #97
    Join Date
    May 2007
    Location
    San Francisco, California
    Beans
    5,843
    Distro
    Ubuntu

    Re: General MoBlock thread

    Thanks for the tutorial, really nice.
    Silver Mt Zion.| Linux user since 2003.

  8. #98
    Join Date
    Aug 2008
    Location
    Brazil
    Beans
    12,497
    Distro
    Ubuntu Studio 12.04 Precise Pangolin

    Re: General MoBlock thread

    Quote Originally Posted by jre View Post
    "reload" is good for you. Then all lists configured in blocklists.list will be unpacked and cat'ted together to the master blocklist /etc/moblock/guarding.p2p. Since you are only using local lsits there's no need to do a "update".
    Thanks. Moblock doesn't merge ranges when creating /etc/moblock/guarding.p2p right?

    Quote Originally Posted by jre View Post
    When you do an "update", moblock-control tries to connect to bluetack first to test if network access is available. I might use another TESTHOST than bluetack.co.uk, or perhaps check this with a more sophisticated way. Currently it's simply downloading bluetack's index.html ...
    So I guess you got an "Error 171: No connection to www.bluetack.co.uk. Aborting!", right?
    Yep, something like that. I don't know the implications of using another TESTHOST, but it might be a good idea, due to recent bluetack's failures.

  9. #99
    Join Date
    Jan 2007
    Beans
    762

    Re: General MoBlock thread

    Quote Originally Posted by lovinglinux View Post
    Thanks. Moblock doesn't merge ranges when creating /etc/moblock/guarding.p2p right?
    No, the resulting list is only cat'ted togerther. This is done by moblock-control. The MoBlock daemon does the merging when it starts and loads the list.

    Thanks Codename!
    Please post your logfiles and output of commands wrapped in code tags:
    Code:
    [code]output[/code]
    Co-author of PeerGuardian Linux (pgl). Maintainer of the pgl package repositories for Debian and Ubuntu.

  10. #100
    Join Date
    Aug 2008
    Location
    Brazil
    Beans
    12,497
    Distro
    Ubuntu Studio 12.04 Precise Pangolin

    Re: General MoBlock thread

    Quote Originally Posted by jre View Post
    No, the resulting list is only cat'ted togerther. This is done by moblock-control. The MoBlock daemon does the merging when it starts and loads the list.
    This is something I would like to better understand.

    I have already noticed that when you reload moblock it re-creates the guarding.p2p file using the current selected lists sources, simply appending all lists ranges to the file, so there is no merging at this point. Then when I start moblock, there is a CPU spike for a while, which I believe is due to MoBlock daemon writing the iptables. After a while, the CPU load goes back to normal and the "Currently blocking xxxx IP ranges" message is updated to reflect the updated number of ranges used. But this number does not correspond to a merged list. For example, when I merge the same lists used on moblock with TinyBLM, there is a significant reduction in the number of ranges, due to range "duplicates" being merged. The log file of TinyBLM provides the total number of ranges before and after merging. When compared to the "Currently blocking xxxx IP ranges" on moblock I get the same number of ranges before merging in the TinyBLM log.

    Additionally, the CPU spike time before updating the number of blocking ranges on mobloquer is much shorter than the one of TinyBLM. When merging lists with TinyBLM sometimes it takes like 20 minutes to complete the merging, while moblock update the iptables pretty fast. Why? Does moblock simply copy the ranges from guarding.p2p and write them to the iptables regardless if they are duplicates or not?

    What happens if the guarding.p2p files has some commented lines? Does moblock ignores these lines or could they screw up my iptable rules? I'm asking this because I use some sources with two commented lines in the beginning of each list and it's kind of annoying to remove them manually.

Page 10 of 65 FirstFirst ... 891011122060 ... LastLast

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •