Flax ovum search-across_the_enterprise
-
Upload
charlie-hull -
Category
Technology
-
view
1.354 -
download
1
description
Transcript of Flax ovum search-across_the_enterprise
![Page 1: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/1.jpg)
Open Source Search for the Enterprise
Charlie HullManaging Director, Flax3rd November 2010OVUM Briefing, Search Across the Enterprise
[email protected]/blog+44 (0) 8700 118334Twitter: @FlaxSearch
![Page 2: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/2.jpg)
Search engine specialists with decades of experience Developers, innovators and strategists Based in Cambridge, UK Technology agnostic – but open source exponents Recently selected as UK Authorized Partner by Lucid
Imagination Customers include Mydeco, NLA, Durrants Ltd, Financial
Times, MediaMiser, MySkreen, Accenture, University of Cambridge Recently asked to present at British Computer Society
and Lucene Revolution conferences
Who are Flax?
![Page 3: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/3.jpg)
“Open-source software (OSS) is computer software that is available in source code form for which the source code and certain other rights normally reserved for copyright holders are provided under a software license that permits users to study, change, and improve the software. […] Some open source software is available within the public domain” (Wikipedia)
What is open source?
![Page 4: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/4.jpg)
“Open-source software (OSS) is computer software that is available in source code form for which the source code and certain other rights normally reserved for copyright holders are provided under a software license that permits users to study, change, and improve the software. […] Some open source software is available within the public domain” (Wikipedia)
What is open source?
![Page 5: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/5.jpg)
It's the work of amateur developers
Myths about open source
![Page 6: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/6.jpg)
It's the work of amateur developers If I use open source, I have to open up my
software/servers/network to all and sundry
Myths about open source
![Page 7: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/7.jpg)
It's the work of amateur developers If I use open source, I have to open up my
software/servers/network to all and sundry Open source software isn't reliable or scalable
Myths about open source
![Page 8: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/8.jpg)
It's the work of amateur developers If I use open source, I have to open up my
software/servers/network to all and sundry Open source software isn't reliable or scalable It's free
Myths about open source
![Page 9: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/9.jpg)
It's the work of amateur developers If I use open source, I have to open up my
software/servers/network to all and sundry Open source software isn't reliable or scalable It's free It's unsupported
Myths about open source
![Page 10: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/10.jpg)
Open source search software
Apache Lucene and Solr are trademarks of The Apache Software Foundation
- Flexible licensing- Vector space model- Java and other languages- Well known and supported
Apache Lucene and Solr are trademarks of The Apache Software Foundation
![Page 11: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/11.jpg)
Open source search software
Apache Lucene and Solr are trademarks of The Apache Software Foundation
- The successor to Muscat- Bayesian probabilistic ranking- C/C++ with language bindings - Highly accurate & scalable
- Flexible licensing- Vector space model- Java and other languages- Well known and supported
Apache Lucene and Solr are trademarks of The Apache Software Foundation
![Page 12: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/12.jpg)
Open source search software
Apache Lucene and Solr are trademarks of The Apache Software Foundation
- The successor to Muscat- Bayesian probabilistic ranking- C/C++ with language bindings - Highly accurate & scalable
- Flexible licensing- Vector space model- Java and other languages- Well known and supported
And more....
Apache Lucene and Solr are trademarks of The Apache Software Foundation
![Page 13: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/13.jpg)
Some exampleshttp://www.nla-clipshare.com
Newspaper Licensing Agency – NLA Clipshare20 million newspaper stories6500 usersContent from every major newspaper (and most regionals)Used by journalists, clippings agencies, media monitorsReplacing internal systems at major newspapers
![Page 14: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/14.jpg)
Some exampleshttp://www.nla-clipshare.com
Newspaper Licensing Agency – NLA Clipshare20 million newspaper stories6500 usersContent from every major newspaper (and most regionals)Used by journalists, clippings agencies, media monitorsReplacing internal systems at major newspapersOne of very few ways to search content from all the papers within hours of publication
![Page 15: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/15.jpg)
![Page 16: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/16.jpg)
![Page 17: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/17.jpg)
![Page 18: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/18.jpg)
Some examples
Financial Times – press cuttingsWeb Service for easy integrationXML source dataFaceted searchArea filters (whole article, body, headline, byline or any combination)Synonyms, spelling suggestions
http://presscuttings.ft.com
![Page 19: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/19.jpg)
Some examples
Financial Times – press cuttingsWeb Service for easy integrationXML source dataFaceted searchArea filters (whole article, body, headline, byline or any combination)Synonyms, spelling suggestionsBuilt from scratch in a fortnightDesigned as a prototype, scaled to production use without significant change
http://presscuttings.ft.com
![Page 20: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/20.jpg)
![Page 21: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/21.jpg)
Some examples
Durrants Ltd. Media monitoring platformThousands of client search profiles Hundreds of thousands of articles per dayComplex publication heirarchyEstablished pipeline
SolutionFlexible query language allows OCR errors, punctuation, fuzzy matching, weightingSupports features of previous engineScalable master-slave architecture
![Page 22: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/22.jpg)
Some examples
Durrants Ltd. Media monitoring platformThousands of client search profiles Hundreds of thousands of articles per dayComplex publication heirarchyEstablished pipeline
SolutionFlexible query language allows OCR errors, punctuation, fuzzy matching, weightingSupports features of previous engineScalable master-slave architecture
Accuracy improved in some cases from 95% rejected to 95% accepted Hardware budget 15% of previous system
![Page 23: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/23.jpg)
Some examples
(Unnamed multinational radio suppliers) Intranet search12 million documentsMultiple formats – Office, PDF, HTML...User and group-based security (LDAP)Faceted searchUsers can 'tag' interesting documents – for
example to identify a 'reference' version
![Page 24: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/24.jpg)
Some examples
(Unnamed multinational radio suppliers) Intranet search12 million documentsMultiple formats – Office, PDF, HTML...User and group-based security (LDAP)Faceted searchUsers can 'tag' interesting documents – for
example to identify a 'reference' versionOpen source chosen because of significant
cost advantage – commercial solutions uneconomic at this scale
![Page 25: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/25.jpg)
A look at Lucene & Solr
Among the top 15 open source projects Installations at over 4,000 companies Downloads have grown nearly 10x over the past three
years Over 7,000 downloads a day.
![Page 26: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/26.jpg)
A look at Lucene & Solr
Among the top 15 open source projects Installations at over 4,000 companies Downloads have grown nearly 10x over the past three
years Over 7,000 downloads a day.
USA based Employs 9 out of 15 top Lucene committers Offers training, consulting and up to 24x7
support Developing value-add software
![Page 27: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/27.jpg)
A look at Lucene & Solr
Among the top 15 open source projects Installations at over 4,000 companies Downloads have grown nearly 10x over the past three
years Over 7,000 downloads a day.
USA based Employs 9 out of 15 top Lucene committers Offers training, consulting and up to 24x7
support Developing value-add software Flax are UK partners & resellers
![Page 28: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/28.jpg)
Lucid Works Enterprise
![Page 29: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/29.jpg)
Who are Lucid working with?
![Page 30: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/30.jpg)
Some Lucene & Solr numbers
LinkedIn – 30 million users Internet Archive – a billion indexed pages Salesforce.com – 8 terabytes of searchable data Twitter – a billion queries a day
![Page 31: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/31.jpg)
Why open source search?
Flexible, extendable
![Page 32: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/32.jpg)
Why open source search?
Flexible, extendable Powerful & scalable
![Page 33: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/33.jpg)
Why open source search?
Flexible, extendable Powerful & scalable Lower cost, especially when planning for growth
![Page 34: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/34.jpg)
Why open source search?
Flexible, extendable Powerful & scalable Lower cost, especially when planning for growth Commercial support available as necessary
![Page 35: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/35.jpg)
Why open source search?
Flexible, extendable Powerful & scalable Lower cost, especially when planning for growth Commercial support available as necessary
- Freedom to innovate
![Page 36: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/36.jpg)
Looking to the future
![Page 37: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/37.jpg)
Looking to the future
More and more content including social media
![Page 38: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/38.jpg)
Looking to the future
More and more content including social mediaMultiple delivery platforms
![Page 39: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/39.jpg)
Looking to the future
More and more content including social mediaMultiple delivery platforms Search-powered applications
![Page 40: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/40.jpg)
Looking to the future
More and more content including social mediaMultiple delivery platforms Search-powered applicationsCloud computing
![Page 41: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/41.jpg)
Looking to the future
More and more content including social mediaMultiple delivery platforms Search-powered applicationsCloud computingMore use of entity extraction & sentiment
analysis
![Page 42: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/42.jpg)
Looking to the future
More and more content including social mediaMultiple delivery platforms Search-powered applicationsCloud computingMore use of entity extraction & sentiment analysis
Search no longer a bolt-on, but a platform for innovation
![Page 43: Flax ovum search-across_the_enterprise](https://reader035.fdocuments.net/reader035/viewer/2022062419/558c0bddd8b42a45568b475d/html5/thumbnails/43.jpg)
Looking to the future
More and more content including social mediaMultiple delivery platforms Search-powered applicationsCloud computingMore use of entity extraction & sentiment
analysis
Search no longer a bolt-on, but a platform for innovationOpen source no longer an outsider, but the obvious choice