Information retrieval

Information Retrieval Search Engines Application of softwares in Veterinary Field AGB 111 2013-14

Information Retrieval (IR)

06/12/13

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

What is information retrieval • Gathering information from a source(s) based on an information need usually from a query • Sources of information – – – – –

Other people Archived information (libraries, maps, etc.)

Radio, TV, etc.

Web (search engines) Nature Information retrieval is more than just web search

06/12/13 3

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Information retrieval vs ?

• Information retrieval (IR) is the activity or process of obtaining information resources relevant to an information need from a collection of information resources.

• Data mining is the process that attempts to discover patterns in large data sets.

• Information extraction (IE) is the task of automatically extracting structured information from unstructured and/or semi-structured machine-readable documents 06/12/13 4

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Data, Information, Knowledge • Data - Facts, observations, or perceptions.

Eg. Telephone number • Information - Subset of data, only including those data that possess context, relevance, and purpose.

Eg. A Phone book • Knowledge - A more simplistic view considers knowledge as being at the highest level in a hierarchy with data (at the lowest level) and information (at the middle level).

Eg. Recognzing the Phone numebr of the person whom you want to contact 06/12/13 5

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Ideal Information Retrieval • Ask someone • Search – Search for someone to ask – Search for needed information - library – Use a search engine • Process of IR - queries or questions

06/12/13 6

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Information to be retrieved • Permanent vs Impermanent information – Conversation, events – Documents (in a general sense) • Text, tweets • Video • Files • Pictures • Data

06/12/13 7

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

How good is the IR system Measures of performance based on what the system returns: • Relevance • Coverage • Recency • Functionality (e.g. query syntax) • Speed • Availability • Usability • Time/ability to satisfy user requests

06/12/13

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

8

How IR systems work Algorithms implemented in software • Gathering of information • Storage of information • Indexing • Interaction • Evaluation

06/12/13 9

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Information Seeking Behavior

• Two parts of the process:

–search and retrieval –analysis and synthesis of search results

06/12/13 10

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

User’s Information Need

Collections Pre-process

text input Parse

Query

Index

Rank or Match

Query Reformulation 06/12/13 12

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Vannevar Bush - Memex - 1945 "A memex is a device in which an individual stores all his books, records, and communications, and which is mechanized so that it may be consulted with exceeding speed and flexibility. It is an enlarged intimate supplement to his memory.�

13

IR History • • • • • •

Interest in computer-based IR from mid 1950’s Key word indexing H.P. Luhn at IBM (1958) Probabilistic models at Rand (Maron & Kuhns) (1960) Boolean system development at Lockheed (‘60s) Vector Space Model (Salton at Cornell 1965) Statistical Weighting methods and theoretical advances (‘70s) • Refinements and Advances in application (‘80s) • User Interfaces, Large-scale testing and application (‘90s)

• Then came the web and search engines and everything changed 06/12/13 14

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Search engines

06/12/13 15

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Definition • Web sites that search for documents based on keywords. • Search engines typically search millions of web sites for text in web pages.

06/12/13 16

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

• Search engines use "spiders" which search the web for information.

• They are software programs (Computer Robots) which request pages.

• In addition to reading the contents of pages for indexing, spiders also record links.

06/12/13 17

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Search engine operates in the following order • Web crawling- helps in retrieving stored information • Indexing-The contents of each page are then analyzed for example, words are extracted from the titles, headings, or special fields called meta tags.

• Searching-Based on the selection of key words.

06/12/13 18

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Query Engine

Index

Interface Indexer Users

Crawler

Web 06/12/13 19

A Typical Web Search Engine Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

06/12/13 20

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Types of search Engine • Individual search engine: It has its own databases of websites and query methods eg. Altavista, Looksmart, Ask,Hotbot etc., • Meta Search Engine: It queries several individual search engines simultaneously and then amalgamates the results eg., Metacrawler, Dogphile, Mama etc.,

06/12/13 21

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Procedure for online searching • Log on-User connects the terminal -identified as legitimate user • Search- Involves selection of search engine and selection of keywords or desired terms.

• Results- User request the result in a chosen format as pre-formatted fields or paragraph either online or offline.

• Log off –The searcher instructs the system to discontinue.

06/12/13 22

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Search Mechanism • Boolean- Use ‘And,’ ‘or’ and ‘not’ to connect words or phrases in the search statement • Plus/Minus- Cloning+Goat • Phrases- enclosed in Double quotes- “Gregor Mendel” • Proximity operators- to specify how close the terms should be-Heat()shock()Proline

06/12/13 23

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Search Mechanism(Contd.) • Nesting- Allows to build complex queries -Structure AND(DNA OR RNA) • Wild card or Truncation Operators- This allows all terms beginning with the same letters to be retrieved- Phyloge? Retrieves Phylogeny, phylogenics, phylogenic tree. etc 06/12/13 24

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

General Tips for Search Strategy Be specific Use + symbol to narrow down search Use phrase searching “” Truncate words to pick singular and plural versions?

• Use synonyms via Or operator • Combine key words into phrases wherever possible eg., “data” “population” • Try alternate spelling • Type your key word in lower case letters • Be persistent and creative!!!!

Dr R Jayashree, Asst. Professor(AGB) 06/12/13 25 • • • •

Veterinary College, Bangalore

Offline Information gateway • Information which is already in the form of CD-ROM,Book, Journals etc., Some of the Offline information CD- ROM • ASFA- Aquatic Sciences and Fisheries Abstracts • BEASTCD- Animal production database • BIOSIS-Biological abstracts • VetCD- Veterinary Science database 06/12/13 26

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Libraries on computer disk (Literature search through CD-ROM)

•

Computers have provided a great facility to research workers and scientists- short time review the literature available in the world.

• E journals or any other journal can be accessed • CD’s containing abstracts on various topics on Veterinary Science published in a number of very important journals are now available in the market.  By subscribing to those CD’s and by using literature search software, we will be able to use the vast amount of information stored in the CD.

06/12/13 27

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Computer Applications in Veterinary and Animal Husbandry practices • • • •

Educational and Information purposes Epidemiology Clinicopathology Animal genetics and Breeding

06/12/13 28

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Various resources • Computer-aided learning in Veterinary education(CLIVE)- learn various aspects of veterinary science • International Veterinary Information centre(IVIC)- Network of computers in the field • Vetstream- species based CD-ROMs • VetWeb- WWW for Veterinary users • Episcope- For epidemiological principles and calculations

06/12/13 29

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

• Computer system for recording events economically important livestock(COSREEL) • ECG diagnostic system to analyze a patient automatically • CARDIO diagnostic system for Veterinarian • HEMO clinic pathological system • Veterinary Investigation Recording User System (VIRUS)- analyzing the individual cow records • Breeding data analysis software • Disease investigation software 06/12/13 30

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

• Animal Husbandry data analysis • Veterinary Practice management software • Computerized herd health information management • Computer packages- LSMLMW, MATLAB,MICROSTAT for analysis of animal breeding and performance data

06/12/13 31

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Softwares for statistical analysis of animal breeding data • ASReml is a statistical software package or fitting linear mixed models using restricted maximum likelihood • GenStat is a general statistical package • GraphPad Prism is a commercial scientific 2D graphing and statistics software.

• SPSS Statistics is a for statistical analysis • SAS is a software suite developed for advance analytics, business intelligence, data management and predictive analysis 06/12/13 32

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Debugging Debugging is the process of locating and fixing or bypassing bugs (errors) in computer program code or the engineering of a hardware device.

To debug a program or hardware device is to start with a problem, isolate the source of the problem, and then fix it.

Debugging tools (called debuggers) help identify coding errors at various development stages. Some programming language packages include a facility for checking the code for errors as it is being written 06/12/13 33

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

Creating Algorithm in Programming

• Algorithm are the set of well defined instruction in sequence to solve a program. • An algorithm should always have a clear stopping point.

06/12/13 34

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

•Inputs and outputs should be defined precisely.

•Each steps in algorithm should be clear and unambiguous.

•Algorithm should be most effective among many different ways to solve a problem.

•An algorithm shouldn't have computer code.

Instead, the algorithm should be written in such a way that, it can be used in similar programming languages.

06/12/13 35

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore

For AGB 111 course refer • http://issuu.com/animalgenetics • http://www.agb111.blogspot.in/

Thank You 06/12/13 36

Dr R Jayashree, Asst. Professor(AGB) Veterinary College, Bangalore