Deep WEB : beyond googling

 

Also known as the invisible web, the deeper web refers to the portion of the Web that is indexed by search engines like Google. According to The New York Times,computer scientist Mike Bergman is credited with coining the term “deep web” in a paper titled “The Deep Web: Surfacing Hidden Value” published in The Journal of Electronic Publishing in August of 2001.

The so-called surface Web, which all of us use routinely, consists of data that search engines can find and then offer up in response to your queries. As for the rest of it? Well, a lot of it's buried in what's called the deep Web. The deep Web (also known as the undernet, invisible Web and hidden Web, among other monikers) consists of data that you won't locate with a simple Google search.

When you surf the Web, you really are just floating at the surface. Dive below and there are tens of trillions of pages. The deep Web contains 7,500 terabytes of information compared to nineteen terabytes of information in the surface Web To understand how the deep web works,you need to know how search engines operates.

How Search Engines Work : Search engines obtain their listings in two ways: Authors may submit their own Web pages, or the search engines "crawl" or "spider" documents by following one hypertext link to another. The latter returns the bulk of the listings. Crawlers work by recording every hypertext link in every page they index crawling. . To give you results, Google (GOOG), Yahoo (YHOO) and Microsoft's (MSFT) Bing constantly index pages. They do that by following the links between sites, crawling the Web's threads like a spider. But that only lets them gather static pages, What they don't capture are dynamic pages, like the ones that get generated when you ask an online database a question.

How is the Deep Web Invisible to Search Engines?

Search engines like Google are extremely powerful and effective at distilling up-to-the-moment Web content. What they lack, however, is the ability to index the vast amount of data that isn’t hyperlinked and therefore immediately accessible to a Web crawler.

The dark web is like the Web’s ID it’s private. It's anonymous. It's powerful. It unleashes human nature in all its forms, both good and bad. Just as Deep Web content can’t be traced by Web crawlers, it can’t be accessed by conventional means.

To dive into deep web you need special software, such as The Onion Router, more commonly known as Tor. Tor is software that installs into your browser and sets up the specific connections you need to access dark Web sites. Critically, Tor is an encrypted technology that helps people maintain anonymity online. It does this in part by routing connections through servers around the world, making them much harder to track.

The dark Web is home to alternate search engines, e-mail services, file storage, file sharing, social media, chat sites, news outlets and whistleblowing sites, as well as sites that provide a safer meeting ground for political dissidents and anyone else who may find themselves on the fringes of society.

New channels are popping up daily in the Deep Web. Currently, marketplace alternatives to Silk Road, Agora, and Pandora are the most frequented.Interestingly, In late October 2014, Facebook enabled Tor browser users to visit them anonymously, saying in a press release that "It’s important to us at Facebook to provide methods for people to use our site securely."

So although the dark Web definitely has its ugly side, it has great potential, too.

"It has been said that what cannot be seen cannot be defined, and what is not defined cannot be understood" ...Deep web