Practical Search in the Cloud
of 18
-
Upload
lucidimagination -
Category
Documents
-
view
219 -
download
0
Transcript of Practical Search in the Cloud
-
8/6/2019 Practical Search in the Cloud
1/18
Practical Search
in the Cloud
(sneak preview)
Martijn Koster, Lucid [email protected]
Wednesday, 25 May 2011
mailto:[email protected]:[email protected] -
8/6/2019 Practical Search in the Cloud
2/18
My Background
Martijn Koster
Sr. Software Engineer at Lucid Imagination Search in early Web WebCrawler
Customer web services Excite Mail Proxies for Mobile Danger
2
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
3/18
What I Will Cover
A Solr based Cloud Service
The need
How
Demo
Wrap up
3
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
4/18
Why? Getting Started is Hard
Many new concepts
Complex software configuration
System Administration overhead
4
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
5/18
Search as a Service
A few clicks to get started
Full Power of LucidWorks and Solr
Offload operations
Expertise, tools and processes are transferable
to your own deployments.
5
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
6/18
Usage Model
6
Web UI
Direct Access
LWE JVM
LWE JVM
Users
UserCode
Lucidworks
Solr
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
7/18
Architecture
7
Web UI(Rails)
Direct Access(Proxy with URL
rewriting)
Control(Chef)
LWE JVMLWE JVM
LWE JVM
Provisioner(Ruby)
Monitoring(Zabbix)
3rd party billingUsers
UserCode
ProvisioningService (Rails)
Heroku
Heroku
SQL(RDS)
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
8/18
Deployment Automation
AMI
Chef
Custom
8
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
9/18
Scaling Heroku
Direct Access
Search Servers
Provisioning/DB
Monitoring and Control
9
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
10/18
Direct Access Example
The Cloudy Direct Access Solr interface
Simple submission
Simple search
First, copy SOLR access URL:
SOLR="https://access.cloudy.io//solr"
11
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
11/18
Example - Add
$ cat > /tmp/doc.xml
-
8/6/2019 Practical Search in the Cloud
12/18
Example - Search
curl $SOLR'/my_news/lucid?q=news&role=DEFAULT&wt=json'
curl $SOLR'/my_news/select?
wt=json&q=news&start=0&rows=10'
13
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
13/18
Example Lucidworks API
The Cloudy Direct Access Lucid API interface
API="http://access.demo.cloudy.io//api
curl $API/collections[
{"name":"lwelogs","instance_dir":"lwelogs{"name":"collection1","instance_dir":"collection1_0"},
{"name":"my_news","instance_dir":"my_news_1"}]
14
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
14/18
Live Demo
Sam Pierson, Director of Product Development
The Web User Interface Administration UI improvements
Log indexing and graphing
API access
Ruby bindings for the LucidWorks REST API
http://rubygems.org/gems/lucid_works
10
Wednesday, 25 May 2011
http://rubygems.org/gems/lucid_workshttp://rubygems.org/gems/lucid_workshttp://rubygems.org/gems/lucid_works -
8/6/2019 Practical Search in the Cloud
15/18
Lessons
Cloud technologies speed up development
Automate everything
Avoid lock-in
Dogfooding
16
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
16/18
Wrap Up
Search as a Service
Built in the Cloud, with open source
Full Lucidworks Enterprise and Solr
Powered by Lucid Imagination
17
Wednesday, 25 May 2011
-
8/6/2019 Practical Search in the Cloud
17/18
When
Early Access Program: July
Interested? [email protected]
18
Wednesday, 25 May 2011
mailto:[email protected]:[email protected] -
8/6/2019 Practical Search in the Cloud
18/18
Contact
Martijn Koster
http://www.lucidimagination.com/
twitter.com/makuk66
19
Wednesday, 25 May 2011
http://www.lucidimagination.com/http://www.lucidimagination.com/http://www.lucidimagination.com/
