background preloader

Week 8: Portals, Directories, the Deep & Dark Web (*=Key reading)

Facebook Twitter

The Invisible Web (Jonas Fransson) (This is originally a chapter from the book Efficient information searching on the web.)

The Invisible Web (Jonas Fransson)

The Invisible Web is hard to define. Several similar concepts are used for its designation. The Invisible Web was coined by a researcher in 1994 for that which wasn’t visible to the search engines. Curlie - The Collector of URLs. Web Directory: Online General and Regional Web Directory. The StartSpot Network -,,,,,,,,,,, and Contact Us Advertising News About Us Network Welcome Book reviews, book awards, poetry, literary criticism, authors & more.

The StartSpot Network -,,,,,,,,,,, and

Movie reviews, movie trailers, movie quotes, movie listings & more. Web Search Tools — The Basics. When you're just getting started using the web, it can be quite overwhelming to understand exactly what tools are best to use to find what you may be looking for.

Web Search Tools — The Basics

There are so many choices: how do I find something online? How do I stay safe while on the web? How do I see what I want to see without a lot of clutter? The web is definitely a two-edged sword; while the availability of information is absolutely astonishing, it also can be quite intimidating if you don't know how to access it in a way that makes sense. That's where basic tools come in that can help you organize information on the web into more meaningful channels. Search EnginesSubject DirectoriesMeta Search Tools None of these search tools allow you to search the entire web; that would be an almost impossible task.

The Evolving Impact of the Invisible Web: Exploring Economic and Political Ramifications (Log into Rutgers Libraries) What's the Deep Web? And Why the Library? *How The Dark Web Became The Platform For All Things Illegal. Searching the Deep Web - Bates InfoTips. I recently developed a private workshop on how to find deep web resources on a specialized topic, and realized that the secret to finding information in the deep web is know that it’s a very different experience than searching the open web.

Searching the Deep Web - Bates InfoTips

While deep web content isn’t indexed by search engines, you can use search engines to find pointers, leads and links to deep web resources. Even more than with most “traditional” searches, looking for deep web content means thinking like a detective — looking for clues, using your peripheral vision to notice references or footnotes, and knowing when to step back and reassess. Following are some of the key approaches I recommend for finding deep web content on a particular topic. Use a search engine to find a page that is describing a relevant database by adding terms likely to appear the page.

To find content on income inequality, for example, you might use a query like “income inequality” (database OR “data set” OR archive OR databank). Marissa Mayer offers historic context of search. Deep Web & Dark Web as Fast As Possible. The Deep Web you don't know about - Mar. 10, 2014. By its very nature, the size of the Deep Web is difficult to calculate.

The Deep Web you don't know about - Mar. 10, 2014

But top university researchers say the Web you know -- Facebook (FB), Wikipedia, news -- makes up less than 1% of the entire World Wide Web. When you surf the Web, you really are just floating at the surface. Dive below and there are tens of trillions of pages -- an unfathomable number -- that most people have never seen. They include everything from boring statistics to human body parts for sale (illegally). Related story: Shodan, the scariest search engine on the Internet Though the Deep Web is little understood, the concept is quite simple. What they don't capture are dynamic pages, like the ones that get generated when you ask an online database a question. "When the web crawler arrives at a [database], it typically cannot follow links into the deeper content behind the search box," said Nigel Hamilton, who ran Turbo10, a now-defunct search engine that explored the Deep Web.

So, what's down there? Examples of portals and directories. The WWW Virtual Library. National Archives. Beaucoup! Reference & Education. for Science - Government Science Portal. The Directory of the Web. Home. RefSeek - Reference Directory. Internet Archive: Digital Library of Free Books, Movies, Music & Wayback Machine. Official Guide to Government Information and Services. JournalTOCs. Digital Public Library of America.

Jasmine Business Web Directory. United Nations Digital Library System. The Reality of the Dark Web: Fake, Funny and Fraudulent.