Unplugged FAST meets SharePoint (FS4SP)

Avneesh Kaushik (Sr. Consultant, MCS)Hemant Kathuria (Consultant, MCS)

Agenda

• FAST Search Feature Overview• FAST Search Architecture & Deployment• FAST Search Connectors• FAST VS SharePoint Search• QA

Features

Explore using navigatorsthat help you understand the scope of information available, with exact counts of results

Improve relevance with usebased on how people tag and rate content in SharePoint and on click-throughs of search results

Visualize your resultsso you can quickly recognize what you’re looking for without opening separate applications

FAST Search for SharePoint 2010

Query completion

Document thumbnails

Scrolling previews

PeopleSearch

Sorting on any property

Refinement with counts on any

property

Go Beyond the Search BoxVisual, Conversational Search

Thumbnails

Sorting on any property

Similarity Search

Visual Best Bets

Scrolling PowerPointPreviews

User Context MattersAlan Brewer, Sales

What should I know about selling ERP consulting?

Renee Lo, Engineer

What should I know about implementing ERP?

Click through improves relevance

Documents are boosted by ‘popularity’: if many users find a document useful, it must be useful.

Architecture

Search Technologies

– INTERNAL ONLY

Storage Overview

SharePoint 2010 FAST Search

SQL Server

Content

Config.

+++

AdminCrawl

Admin

Property

FAST Query SSA(search + people crawl)

Crawl

Admin

Property

FAST Content SSA(crawl only)

GeneralSharePoint

FAST Search

UnusedLess used

From:FAST

From:SP

Localdisk

– INTERNAL ONLY

ArchitectureSharePoint Farm

FAST Search Server 2010 for SharePoint Farm

QueryProcessing

Query SSA (Search Service

Application)

Web LinkAnalysis

Microsoft System CenterOperations Manager

Content SSA (FAST SearchConnector)- SharePoint- BDC- Exchange- Web

Site Collection Admin UI• Deployment• User Context Management• Promotion/Demotion

Indexing

QueryMatching

FAST SearchAuthorization

(FSA)

FAST IndexingConnectors

Content

Content

Monitoring

External federation sources

!!

People Search(query/crawl)

ActiveDirectory

Content

Administration

PowerShell• Schema configuration• Admin configuration• Deployment

configuration

Central Administration UI • Property mapping• Property extraction• Spell-checking

Item Processing

Web Server

Query Web Service

Federation Object Model

Custom front-end

Web Parts

FAST SearchQuery

User Profile

s

– INTERNAL ONLY

Deployment.xml

<?xml version="1.0" encoding="utf-8" ?> <deployment version="14" modifiedBy="contoso\user" xmlns=”http://www.microsoft.com/enterprisesearch” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xsi:schemaLocation="http://www.microsoft.com/enterprisesearch deployment.xsd"> <instanceid>XS1</instanceid> <connector-databaseconnectionstring> [<![CDATA[jdbc:sqlserver://sqlbox.contoso.com\sql:1433;DatabaseName=XS1.jdbc]]> </connector-databaseconnectionstring> <host name="fs4sp1.contoso.com"> <admin />

<query /><content-distributor />

<indexing-dispatcher /> <searchengine row="0" column="0" /> <webanalyzer server="true" link-processing="true" lookup-db="true" max-targets="4"/>

<document-processor processes="12" /> </host> <searchcluster> <row id="0" index="primary" search="true" /> </searchcluster></deployment>

Sample deployment.xml for generic single node install :

– INTERNAL ONLY

WFEWFE

FAST Query SSAFAST Query SSA

Query ProcessingQuery Processing

FAST Search – Query Side HA

Query Matching

Query Processing

FAST Query SSA

Web Front End (WFE)

Extra search row

SharePoint

FAST Search

FAST Search – Query Data Flow

FAST Content SSA

• The FAST Search Connector is a Search Service Application (SSA) that retrieves content for indexing from SharePoint farms and other content repositories, it runs on a SharePoint application server.

• Create all the Content Sources other than People Search

• Crawl components are associated with FAST Search Content SSA. You can distribute the crawl load by adding crawl components to different farm servers.

Connectors

Secure, unified access to information

Access content securelywith a full-featured content crawler and both index- and query-time trimming of results

Federate queriesusing OpenSearch to quickly access existing search indexes and online information services

Extend your reachusing Business Connectivity Services to access your content sources and business applications

OpenSearch Federation

Indexing Connectors

EnterpriseContent

Business Application

s

Information Services

User Experience

Search Index

Websites and Intranet

File Shares

IBM Lotus Notes

EMC Documentum

SharePoint Server

Exchange Public Folders

AD & LDAP Profiles

Etc …

Federate queriesusing OpenSearch to quickly access existing search indexes and online information services

– INTERNAL ONLY

BCS Overview

External Lists Search

External Data

Columns

Web Parts

User Profiles Importe

r

Custom Solution

s

Workflow

Business Data Connectivity Service (BDC)Metad

ata Store

Web Servic

es

.Net Connecti

vity Assembly

Custom

Database

– INTERNAL ONLY

BCS Stereotyped Operations

Core Operations• Finder • SpecificFinder

Item Level Security• BinarySecurityDescriptorAcce

ssor

Incremental CrawlsChangedIdEnumeratorDeletedIdEnumerator

AttachmentsStreamAccessor

– INTERNAL ONLY

Tooling for Connectors

• SharePoint Designer 2010– Create BDC model files for OOB BDC Connector Types – Export BDC model files between BCS services

applications– Limited set of capabilities.

• Visual Studio 2010– Implement a .NET BDC Connector (Using BDC

model VS2010 Template)– Write Custom BDC Connector for your repository

(No VS2010 Template Support)

FAST VS SharePoint Search

FAST VS SHAREPOINT SearchFeature Description SharePoint

2010FAST Search

Out of the Box Search Center √ √

Advanced Search• Provides end users with the ability to search

using all/some/none of these words, restrictingto particular document types or languages, orspecific property values.

√ √

FQL Scopes• Users can filter results using FAST Query

√

People Search• Search users to find people by name or expertise.

√ √

Custom Properties• Create new managed properties ,• Map crawled properties to managed properties V• Manage how properties are indexed and how• these are treated in the search results.

√ √

Property Extraction• Extract key information (peoples names, company names, and locations).• Use this new information for sorting, querying, refinement.• Limited: title, author, and date only.

Limited √

Feature Description SharePoint 2010

FAST Search

Custom Processing• Programmatically process content through an extensibility stage

√

Shallow Results Refinement √ √Deep Results Refinement• The extraction is supported by custom dictionaries and allows the

user to refine and sort data that they care about.

√

Similarity Search• Explore additional results that are similar to a particular document in

the search result set.

√

Document and Site Promotions• Promote individual documents by keyword• Promote sites

√

Customized Rank Profiles• Customize rank profiles for different search centers.

√

Managed Property Boosting• Assign weight to the value of a specific attribute (defined as a Managed Property) of a document.• Add ranking boost for specific values of a Managed Property.

√

FAST VS SHAREPOINT Search

FAST VS SHAREPOINT SearchFeature Description SharePoint

2010FAST Search

Flexible Sorting• The administrator can enable sorting on any metadata

property• These properties are exposed for sorting to the end user

√

Visual Best Bets √Query Suggestions• Improve with use by suggesting search queries that were

successful for other users.

√ √

Document Previews and Thumbnails• Display thumbnails of Word and PowerPoint documents. • Display inline scrollable previews of PowerPoint files on the

results page.

√

Offensive Content Processing √Managed property stemming• Enable managed property stemming support for word forms.

√

Additional Document Format Support• Conversion from native document format to indexable text for

400+ document formats

√

Feature Description SharePoint 2010

FAST Search

Advanced Linguistics Processing• 30+ languages to enable tokenization, linguistics normalization and

index-based spell checking

√

User Contexts• Targeted communication towards specific groups of users.• You can associate Best Bets, Visual Best Bets, synonyms, and document

promotions with a user context.

√

Highly capable and easy to manage• Extreme scale-out and performance• Easy deployment• Enterprise-class manageability

√

Lotus Notes Content• Indexes Lotus Notes content. • Limited: does not include Lotus Notes roles.

Limited √

FAST VS SHAREPOINT Search

Q & A

FAST Capabilities, Deployment, Connectors

ResourcesSoftware Application

Developers

http://msdn.microsoft.com/

Infrastructure Professionals

http://technet.microsoft.com/

msdnindia technetindia @msdnindia @technetindia

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and

Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.