Hidden Web and Online Learning Resources Aim of the session Accessing “good” information for...

Hidden Web and Online Learning Hidden Web and Online Learning ResourcesResources

Aim of the session

Accessing “good” information for academic / research / educational

purposes not accessible via standard search engines

TAFE NSW – Sydney InstituteTAFE NSW – Sydney Institute

Ultimo College LibraryUltimo College Library

Presenters:Presenters:

Beatriz ArocheR/Educational Services LibrarianUltimo College Library9217 4689

Diana KhabbazA/Manager Staff LearningLearning & Innovation9217 4211

Hidden Web and Online Learning Resources

End of the session End of the session Understand what constitutes the Understand what constitutes the

“hidden web” or “invisible web”“hidden web” or “invisible web” Learn ways of accessing that Learn ways of accessing that

information (with particular ref to information (with particular ref to Online Learning Resources) using Online Learning Resources) using directories, databases and search directories, databases and search enginesengines

Understand how to use search Understand how to use search engines more effectivelyengines more effectively

TAFE NSW – Sydney Institute, Ultimo College Library

The numbers of documents that remain unindexed?

around 550 billionaround 550 billion


The Deep WebThe Deep Web

What is the visible web?

Content that can be indexed and Content that can be indexed and searched by ordinary search searched by ordinary search engines.engines.


What is the invisible (hidden / deep) web?

Files, images, and web sites, Files, images, and web sites, that for a variety of reasons, that for a variety of reasons, cannot be indexed by popular cannot be indexed by popular search engines like Google. search engines like Google.


Why don’t search engines index this stuff?

Search engine results are found by computer Search engine results are found by computer programs called spiders or robots and generally programs called spiders or robots and generally exclude:exclude:

Specialised databases (e.g. ANZRC, Factiva) where a Specialised databases (e.g. ANZRC, Factiva) where a username and password is required. username and password is required.

Searchable databases where the pages generated Searchable databases where the pages generated are dynamic (e.g. library catalogues, white pages) are dynamic (e.g. library catalogues, white pages) Pages containing a “?” in the URL.Pages containing a “?” in the URL.


So…how do we find these wonderful “hidden” sites?

Directories (general or subject specific)Directories (general or subject specific)

Specialised Databases (subscribed to by Specialised Databases (subscribed to by your library or freely available)your library or freely available)

Effective use of search enginesEffective use of search engines


General or subject specificGeneral or subject specific Indexed by real peopleIndexed by real people Expensive to createExpensive to create High relevancy, low recallHigh relevancy, low recall Can be indiscriminate in quality or Can be indiscriminate in quality or

expert createdexpert created

Directories


Online Learning Directories / DatabasesOnline Learning Directories / Databases

TALETALE

Flexible Learning ToolboxesFlexible Learning Toolboxes

EdNaEdNa

ProveITProveIT


TaleTaleTeaching & Learning ExchangeTeaching & Learning Exchange

DET NSW schools & TAFE statewide DET NSW schools & TAFE statewide resourcesresources

Access to quality teaching & learning Access to quality teaching & learning resources resources

Professional Learning Communities PLCs Professional Learning Communities PLCs www.tale.edu.auwww.tale.edu.au DET User ID & passwordDET User ID & password


Flexible Learning ToolboxesFlexible Learning Toolboxes

Australian Flexible Learning FrameworkAustralian Flexible Learning Framework Competency based national resources Competency based national resources

available in CD Rom formatavailable in CD Rom format http://toolboxes.flexiblelearning.net.au/http://toolboxes.flexiblelearning.net.au/


EdNAEdNAEducationEducation NetworkNetwork AustraliaAustralia

A directory about education and training in A directory about education and training in Australia (DEST) Australia (DEST)

A database of web-based resources useful A database of web-based resources useful for teaching and learningfor teaching and learning

http://www.edna.edu.auhttp://www.edna.edu.au


ProveITProveIT

DET quick and easy toolkit for collecting DET quick and easy toolkit for collecting evidence for assessment and recognitionevidence for assessment and recognition

Currently a limited list of coursesCurrently a limited list of courses http://proveit.tafensw.edu.au/http://proveit.tafensw.edu.au/


Other freely available course Other freely available course resourcesresources

Curriki (new) Curriki (new) www.curriki.orgwww.curriki.org

Open source curriculaOpen source curricula

High quality educational resourcesHigh quality educational resources

OER CommonsOER Commonswww.oercommons.orgwww.oercommons.org

Teaching and learning network offering a broad Teaching and learning network offering a broad selection of materials for freeselection of materials for free

DMOZ– General Open directory (DMOZ): maintained by volunteers and in partnership with Google.http://dmoz.org/

INTUTE – Web resources across subject areas. http://www.intute.ac.uk

PINAKES – Directory of directories / gateways.http://www.hw.ac.uk/libWWW/irn/pinakes/pinakes.html

INFOMINE – compiled by librarians for university students and staff.http://infomine.ucr.edu/

Other directories - Examples


e.g. How to find directories when you know the name but not the URL


Specialised Databases, examples…Specialised Databases, examples…

Specialised databases - no subscription needede.g. EDNA , ERIC (education)

http://www.eric.ed.gov/

Specialised databases - subscription needed e.g. Factiva, ANZRC, AST-FT, Australian Standards, MasterFile Premier,Infotrac, Proquest,

Subject specific search engines e.g. SCIRUS (Science), MedHunt, OSTI


Specialised DatabasesSpecialised DatabasesHow to find them…How to find them…

Using search enginese.g. type Science database or “Australian art” database, education database

Using subject specific directories of gatewayse.g. BUBL, http://bubl.ac.uk/

Librarian’s index to the Internet www.lii.org ,Pinakes

Using Invisible web directoriese.g Complete Planet www.completeplanet.com

Using the subscribed specialised databases available in your librarye.g. Factiva, ANZRC, Australian Standards, MasterFile,Infotrac, Proquest


Search Engines

General:General: Google http://www.google.com Google http://www.google.com

Yahoo http://www.yahoo.com Yahoo http://www.yahoo.com Ask.com http://www.ask.com Ask.com http://www.ask.com Live.com http://www.live.com Live.com http://www.live.com

Exalead.com http://www.exalead.com Exalead.com http://www.exalead.com

Australian:Australian: Sensis – www.sensis.com.au Sensis – www.sensis.com.au


Source: Source: NetRatingsforSearchengineWatch.comNetRatingsforSearchengineWatch.com

e.g. General search engine - ask.come.g. General search engine - ask.com

Suggestions to narrow

search


e.g. Google - Cheat Sheet


e.g. Google - Cheat Sheet…. Continued …

Comparison: Yahoo vs Googlehttp://ranking.thumbshots.com


Effective Use of Search Engines

Use ADVANCED SEARCH and search tipsUse ADVANCED SEARCH and search tips Use more than one word – make it as Use more than one word – make it as

specific as possiblespecific as possible Use synonyms, and try different spellingsUse synonyms, and try different spellings Use “ ” for phrase searchingUse “ ” for phrase searching Use a minus sign to excluded a word or Use a minus sign to excluded a word or

term e.g. “Aboriginal art” –galleriesterm e.g. “Aboriginal art” –galleries Use -.com to excluded commercial sites, Use -.com to excluded commercial sites,

etc. etc.


MetaSearch Engines

Metasearch engines search more than one Metasearch engines search more than one search engine at a timesearch engine at a time

ExamplesExamples Dogpile Dogpile http://dogpile.comhttp://dogpile.com Clusty Clusty http://clusty.comhttp://clusty.com Metacrawler Metacrawler http://metacrawler.comhttp://metacrawler.com Jux2 Jux2 http://jux2.comhttp://jux2.com


Search Engines - AcademicSearch Engines - Academic

Google Scholar Google Scholar http://www.googlescholar.comhttp://www.googlescholar.com

Yahoo mindset Yahoo mindset http://mindset.research.yahoo.comhttp://mindset.research.yahoo.com

Live.com academic Live.com academic http://www.live.com http://www.live.com


Best method for searching? (General)

Define your needsDefine your needs Choose the best starting point – Choose the best starting point –

search or browse?search or browse? Re-assess your strategyRe-assess your strategy

Useful GuideUseful Guide Noodle Tools – Choose the Best Noodle Tools – Choose the Best

SearchSearch


e.g. Noodle Tools – help for online research

http://www.noodletools.com/

e.g. Noodle Tools … continued….

WEB 2.0WEB 2.0

What is web 2.0?What is web 2.0?

The technical heart The technical heart of Web 2.0 is the of Web 2.0 is the two-way link: ie, two-way link: ie,

the RSS link.the RSS link.

The Social aspect is The Social aspect is the two-way flow of the two-way flow of

information…information…

Web1Web1 Web2Web2

Banner adsBanner ads Google adsGoogle ads

Brittanica Brittanica OnlineOnline

WickipediaWickipedia

Personal Personal websiteswebsites

Blogs - Blogs - etcetc

publishingpublishing participatingparticipating

stickinessstickiness syndicatingsyndicating

directoriesdirectories taggingtagging

Source: O’reillySource: O’reilly

Consider these web features:Consider these web features:


RSSRSS TaggingTagging Social sites Blogs and wikisSocial sites Blogs and wikis Podcasts, webcasts,vodcasts, etcPodcasts, webcasts,vodcasts, etc Specialised search engines: Specialised search engines:

http://crossengine.com http://crossengine.com

WEB 2.0WEB 2.0


Alert Services

Google NewsGoogle Newsalso – note the personalization features of Google also – note the personalization features of Google and live.com – and live.com – Google's is shown belowGoogle's is shown below

ANZRCANZRC ProquestProquest FactivaFactiva RSS FeedsRSS Feeds BlogsBlogs


Hidden Web and Online Learning Resources Aim of the session Accessing “good” information for...

Documents

Transcript of Hidden Web and Online Learning Resources Aim of the session Accessing “good” information for...