99 Resources to Research & Mine the Invisible Web
College researchers often need more than Google and Wikipedia to get the job done. To find what you're looking for, it may be necessary to tap into the invisible web, the sites that don't get indexed by broad search engines. The following resources were designed to help you do just that, offering specialized search engines, directories, and more places to find the complex and obscure. Search Engines Whether you're looking for specific science research or business data, these search engines will point you in the right direction. Turbo10: On Turbo10, you'll be able to search more than 800 deep web search engines at a time. Databases Tap into these databases to access government information, business data, demographics, and beyond. GPOAccess: If you're looking for US government information, tap into this tool that searches multiple databases at a time. Catalogs If you're looking for something specific, but just don't know where to find it, these catalogs will offer some assistance. Directories
The Best Reference Sites
Whether you're looking for the average rainfall in the Amazon rainforest, researching Roman history, or just having fun learning to find information, you'll get some great help using my list of the best research and reference sites on the Web. About.com: I've found many answers to some pretty obscure questions right here at About.Reference.com.Extremely simple to use, very basically laid out.Refdesk.com.Includes in-depth research links to breaking news, Word of the Day,and Daily Pictures. A fun site with a ton of information.Encyclopedia.com. As stated on their site, Encyclopedia.com provides users with more than 57,000 frequently updated articles from the Columbia Encyclopedia, Sixth Edition.Encyclopedia Brittanica. One of the world's oldest encyclopedias online.Encarta.Put together by Microsoft.
List of academic databases and search engines
From Wikipedia, the free encyclopedia This article contains a representative list of notable databases and search engines useful in an academic setting for finding and accessing articles in academic journals, institutional repositories, archives, or other collections of scientific and other articles. Databases and search engines differ substantially in terms of coverage and retrieval qualities.[1] Users need to account for qualities and limitations of databases and search engines, especially those searching systematically for records such as in systematic reviews or meta-analyses.[2] As the distinction between a database and a search engine is unclear for these complex document retrieval systems, see: the general list of search engines for all-purpose search engines that can be used for academic purposesthe article about bibliographic databases for information about databases giving bibliographic information about finding books and journal articles. Operating services[edit] [edit] [edit]
ERIC – World’s largest digital library of education literature
Invisible Web
What is the "Invisible Web", a.k.a. the "Deep Web"? The "visible web" is what you can find using general web search engines. It's also what you see in almost all subject directories. The "invisible web" is what you cannot find using these types of tools. The first version of this web page was written in 2000, when this topic was new and baffling to many web searchers. These types of pages used to be invisible but can now be found in most search engine results: Pages in non-HTML formats (pdf, Word, Excel, PowerPoint), now converted into HTML. Why isn't everything visible? There are still some hurdles search engine crawlers cannot leap. The Contents of Searchable Databases. How to Find the Invisible Web Simply think "databases" and keep your eyes open. Use Google and other search engines to locate searchable databases by searching a subject term and the word "database". Examples: plane crash database languages database toxic chemicals database Remember that the Invisible Web exists.
Database search engine
There are several categories of search engine software: Web search or full-text search (example: Lucene), database or structured data search (example: Dieselpoint), and mixed or enterprise search (example: Google Search Appliance). The largest web search engines such as Google and Yahoo! utilize tens or hundreds of thousands of computers to process billions of web pages and return results for thousands of searches per second. High volume of queries and text processing requires the software to run in highly distributed environment with high degree of redundancy. Searching for text-based content in databases or other structured data formats (XML, CSV, etc.) presents some special challenges and opportunities which a number of specialized search engines resolve. Database search engines were initially (and still usually are) included with major database software products. See also[edit] External links[edit] Searching for Text Information in Databases
100 Useful Tips and Tools to Research the Deep Web
By Alisa Miller Experts say that typical search engines like Yahoo! and Google only pick up about 1% of the information available on the Internet. The rest of that information is considered to be hidden in the deep web, also referred to as the invisible web. Meta-Search Engines Meta-search engines use the resources of many different search engines to gather the most results possible. SurfWax. Semantic Search Tools and Databases Semantic search tools depend on replicating the way the human brain thinks and categorizes information to ensure more relevant searches. Hakia. General Search Engines and Databases These databases and search engines for databases will provide information from places on the Internet most typical search engines cannot. DeepDyve. Academic Search Engines and Databases The world of academia has many databases not accessible by Google and Yahoo! Google Scholar. Scientific Search Engines and Databases Science.gov. Custom Search Engines CustomSearchEngine.com. Del.icio.us.
Deep Web Research 2009
Bots, Blogs and News Aggregators is a keynote presentation that I have been delivering over the last several years, and much of my information comes from the extensive research that I have completed into the “invisible” or what I like to call the “deep” web. The Deep Web covers somewhere in the vicinity of 1 trillion pages of information located through the World Wide Web in various files and formats that the current search engines on the Internet either cannot find or have difficulty accessing. Search engines find about 20 billion pages at the time of this publication. In the last several years, some of the more comprehensive search engines have written algorithms to search the deeper portions of the world wide web by attempting to find files such as .pdf, .doc, .xls, ppt, .ps, and others. These files are predominately used by businesses to communicate information within their organization, or to disseminate information to external communities. Bot Research
