IANA — Example domains

php - Why does wget only download the index.html for some websites? - Stack Overflow
▻http://stackoverflow.com/questions/11124292/why-does-wget-only-download-the-index-html-for-some-websites

#Wget is also able to download an entire website. But because this can put a heavy load upon the server, wget will obey the robots.txt file.

wget -r -p ►http://www.example.com

The -p parameter tells wget to include all files, including images. This will mean that all of the HTML files will look how they should do.

So what if you don’t want wget to obey by the robots.txt file? You can simply add -e robots=off to the command like this:

wget -r -p -e robots=off ►http://www.example.com

As many sites will not let you download the entire site, they will check your browsers identity. To get around this, use -U mozilla as I explained above.

wget -r -p -e robots=off -U mozilla ►http://www.example.com

A lot of the website owners will not like the fact that you are downloading their entire site. If the server sees that you are downloading a large amount of files, it may automatically add you to it’s black list. The way around this is to wait a few seconds after every download. The way to do this using wget is by including —wait=X (where X is the amount of seconds.)

you can also use the parameter: —random-wait to let wget chose a random number of seconds to wait. To include this into the command:

wget —random-wait -r -p -e robots=off -U mozilla ►http://www.example.com

MDwiki - Markdown based wiki done 100% on the client via javascript
▻http://dynalon.github.io/mdwiki/?_escaped_fragment_=index.md#!index.md

Requirements

Webspace (or a web server that can serve static files)
Any modern Webbrowser
mdwiki.html file

How does it work?

Just drop the mdwiki.html available from the download page along with your markdown files on a webspace somewhere. You can pass any url (relative to the mdwiki.html file) to mdwiki after the hashbang #!:

▻http://www.example.com/mdwiki.html#!myfile.md

If you rename the mdwiki.html into index.html, you can omit the filename on most webservers:

▻http://www.example.com/#!myfile.md

MDwiki will load a file called index.md from the same directory as the index.html by default, so if you use an index.md file as entry point, all you have to do is enter your domain name:

►http://example.com

Note: There are lots more features over regular Markdown, check out the quickstart tutorial.

#cccp ?

The proliferation of the Autocomplete function on popular Web sites is a case in point. Nominally, all it does is complete your search query - on YouTube, on Google, on Amazon - before you’ve finished typing, using an algorithm to predict what you’re most likely typing. A nifty feature - but it, too, reinforces primness.

How so? Consider George Carlin’s classic comedy routine “Seven Words You Can Never Say on Television.” See how many of those words would autocomplete on your favorite Web site. In my case, YouTube would autocomplete none. Amazon almost none (it also hates “penis” and “vagina”). Of Carlin’s seven words, Google would autocomplete only “piss.”

►http://www.nytimes.com/2012/11/18/opinion/sunday/you-cant-say-that-on-the-internet.html

#censorship #Web