Understanding Your FAST Search 2010 for SharePoint Application Topology

(1)

Understanding Your FAST Search 2010

for SharePoint Application Topology

Daniel Webster

MCT, MCSE: Security + Internet, MCSA, MCTS: MOSS07 Co-author, Microsoft Office SharePoint Server 2007 Administrator’s Companion

Technical Editor, Microsoft Office SharePoint Server 2007 Best Practices

Co-author, Microsoft SharePoint Server 2010 Administrator’s Pocket Consultant

Contributing author, Microsoft SharePoint Server 2010 Administrator’s Companion

(2)

2 |SharePoint Saturday Atlanta 2 |SharePoint Saturday Atlanta

(3)

(4)

(5)

(6)

• We are Experts in Enabling Enterprise SharePoint Success • We view SharePoint as a Platform for Innovation in your

organization

• Microsoft Certified Partner with multiple Gold competencies specializing in the Business Productivity infrastructure —

including SharePoint and FAST Enterprise Search • Our proven Solutions include:

Summit 7 Systems

• SharePoint Platform Solutions

• Enterprise Content Management

• Enterprise Search

• Business Process Mapping

• Internet Solutions/Web Content Management

• Extranet Solutions

(7)

Can We Help You? – Yes We Can!

To discuss your biggest obstacle and find out how we can work together to Conquer Your Mountain

Visit our website at:

www.summit7systems.com

Or give us a call at: 256-585-6868

(8)

Agenda

• FAST Search 2010 for SharePoint: Two Worlds • SharePoint Components

• Inside FS4SP

• FAST Components

• Scaling: Why Would You? • Additional Resources

(9)

“How To”

• For PowerShell scripts see Search Topology Operations in SharePoint Server 2010 at

http://technet.microsoft.com/en-us/library/ff696763.aspx

• For UI instructions see Farm Topology Management at

http://technet.microsoft.com/en-us/library/cc262321.aspx

(10)

FAST Search

for SharePoint

End

Users Content +

Profiles

FAST Search Extends SharePoint Server Search

Unique Social Search from SharePoint Server 2010

Common connectors and content APIs Common query and

federation APIs

Content Search based on FAST ESP

Common IT Pro and developer experience

SharePoint Server 2010

(11)

SharePoint Search Components

• Administration Component

• Search Query and Site Settings service • Crawl Components

• Crawl Databases

• Property Databases • Index Partition

• Query Component(s) • Host Distribution Rules

(12)

Search Databases & SQL

• Search requires three databases. Your environment may include multiple Property and Crawl databases. • The Search administration database is typically

small: allocate 10 GB.

• To estimate the required storage for your Property and Crawl databases, use the following multipliers:

– Crawl: 0.046 × (sum of content databases) – Property: 0.015 × (sum of content databases)

(13)

Search Databases & SQL

The IOPS requirements for Search are significant. • For the Crawl database, search requires from

3,500 to 7,000 IOPS.

• For the Property database, search requires 2,000 IOPS.

(14)

SharePoint Search Topology

For a recorded presentation on scaling the SharePoint components topology, see

(15)

FS4SP Overview (SharePoint)

SharePoint Farm

FAST Search Server 2010 for SharePoint

FAST Query SSA

People Search External Federated Sources Active Directory

Microsoft System Center Operations Manager

Site Collection Administration UI · Deployment

· User Context Management

· Site / Document Promotion & Demotion

· Keywords / Synonyms / Best Bets

PowerShell · Schema Configuration · Admin Configuration · Deployment Configuration Central Administration UI · Property Mapping · Property Mapping · Spell Checking · Reports

FAST Connector SSA

· SharePoint · BDC · Exchange · Web Q u e ry O b je c t M o d e l Federated Object Model

Query Web Service

C u s to m S e a rc h A p p li c a ti o n

(16)

FAST Components

Indexing Query Matching Search Cluster Administration Query Processing Indexing Dispatcher Item Processing Content Dispatcher Web Analyzer

(17)

FAST Connectors

• Web Crawler

• Database (JDBC)

(18)

(19)

(20)

Configurable content processing pipeline

Transform and process content automatically

Strong linguistic coverage 80+ languages detected

45 languages with advanced linguistics features

Property Extraction to create new metadata

Prebuilt extractors: Person, Location, Company

Generic extractors to extend Extensibility

The Content Pipeline

Processing & refinement

…

REDMOND, Wash., and

OSLO, Norway — Jan. 8, 2008

Microsoft Corp. (Nasdaq

“MSFT”) today announced that it will make an offer to acquire Fast Search &

Transfer ASA (OSE: “FAST”),

a leading provider of

enterprise search solutions, through a cash tender offer for 19.00 Norwegian kroner (NOK) per share. This offer represents a 42 percent premium to the closing

share price on Jan. 4, 2008

(the last trading day prior to this announcement)

(21)

(22)

(23)

Search Center

Content

User Profiles

… …

Longitude FAST Integration

Si lv e r L ig h t C o n v e rs io n Longitude Search

(24)

Deployment.xml: Admin

<document-processor processes="12" />

<webanalyzer server="true" max-targets="4" link-processing="true" lookup-db="true"

redundant-lookup="false" /> <query />

(25)

Deployment.xml: Application Server

<host name=“fastapp1.s7gear.com"> <document-processor

processes="12"></document-processor> <indexing-dispatcher />

<webanalyzer server="false" max-targets="4" link-processing="true" lookup-db="true"

redundant-lookup="true" /> </host>

(26)

Deployment.xml: Cluster Member

<indexing-dispatcher />

(27)

FS4SP Components

(28)

FS4SP Search Cluster Components

(29)

Scaling for Availability (SharePoint)

• Load Balanced Crawl Targets

• Create Multiple Crawl Components per Database Across Multiple Servers

• Create Multiple Query Components Across Multiple Servers

(30)

Scaling for Crawling

• Add Crawl Databases • Add SQL Servers

• Use Host Distribution Rules

• Add Crawling Components & Servers • Add Dedicated Crawl Targets

(31)

Scaling for Query Performance

• Partition the Index

(32)

Scaling Document Processing

• Add DocProcessors (automatic load balancing)

– To Cluster Members

– To Dedicated Application Servers

• Add Web Analyzers

– To Cluster Members

– To Dedicated Application Servers

(33)

Scaling Indexing

• Add Columns to increase Indexing capacity • Add Indexer Rows to increase Recoverability • Add Indexing Dispatchers (Can be outside

(34)

Scaling Query Matching

• Add Query Matching Rows To Increase Availability and Performance

• Add Query Processing Components (Can be outside cluster.)

(35)

Scaled Out Farm

Heading Heading Heading MOSS Farm FAST09-017 WFE #2

FAST Search Farm

TK5-FSTCRL-01 FS14 Crawl 1 Central Admin Using SQL cluster1 TK5-FSTCRL-02 FS14 Crawl 2 Using SQL Cluster 1 TK5-FSTCRL-03 People Query 1 People Crawl Component 1

Using SQL Cluster 2

TK5-FSTCRL-04 People Query 2 People Crawl Component 2

Using SQL Cluster 2 TK5-FSTCRL-05 Admin ConfigServer Spelltuner SamAdmin Using SQL Cluster 2 TK5-FSTCRL-06 QRServer WA Admin WA Worker WA Lookup DB TK5-FSTCRL-07 QRServer WA Worker WA Lookup DB TK5-FSTCRL-08 QRServer WA Worker WA Lookup DB TK5-FSTCRL-09 Content Distributor 1 Indexing dispatcher 1 6 Docproc (Enterprise crawler) TK5-FSTCRL-10 Content Distributor 2 Indexing Dispatcher 2 6 Docproc (Enterprise crawler) TK5-FSTIDX-03 Index/Search 4 Docproc TK5-FSTIDX-05 Index/Search 4 Docproc TK5-FSTIDX-07 Index/Search 4 Docproc TK5-FSTIDX-09 Index/Search 4 Docproc TK5-FSTIDX-11 Index/Search 4 Docproc TK5-FSTIDX-13 Index/Search 4 Docproc TK5-FSTIDX-15 Index/Search 4 Docproc TK5-FSTIDX-17 Index/Search 4 Docproc TK5-FSTIDX-19 Index/Search 4 Docproc TK5-FSTIDX-21 Index/Search 4 Docproc TK5-FSTIDX-04 Index/Search TK5-FSTIDX-06 Index/Search TK5-FSTIDX-08 Index/Search TK5-FSTIDX-10 Index/Search TK5-FSTIDX-12 Index/Search TK5-FSTIDX-14 Index/Search TK5-FSTIDX-16 Index/Search TK5-FSTIDX-18 Index/Search TK5-FSTIDX-20 Index/Search TK5-FSTIDX-22 Index/Search TK5-FSTIDX-01 Index/Search 4 Docproc TK5-FSTIDX-02 Index/Search TK5-FSTIDX-23 Index/Search 4 Docproc TK5-FSTIDX-24 Index/Search Dedicated Targets

(36)

Additional Resources: Online

• Manage search topology

(http://technet.microsoft.com/en-us/library/ee805956(office.14).aspx) • Technical diagrams

(http://technet.microsoft.com/en-us/library/cc263199(office.14).aspx)

• Search cmdlets (http://technet.microsoft.com/en-us/library/ee906563(office.14).aspx)

(37)

Additional Resources: Books

• Microsoft SharePoint Server 2010

Administrator’s Pocket Consultant

• Microsoft SharePoint Server 2010

Administrator’s Companion

• Professional Microsoft Search

• Working with FAST Search Server 2010 for

(38)

Free Online Training

http://technet.microsoft.com/en-us/enterprisesearch/ff961003.aspx

(39)

 @SPS_ATL #SPSATL

 speaker sponsor

 

Session Prizes

1 Starbucks - 4 $25 gift cards 2 MSFT Store – 2 $50 gift cards

Lunch Kindle Fire!

3 Best Buy – 2 $50 gift cards 4 Amazon.com – 4 $50 gift cards 5 iTunes – 4 $50 gift cards

GRAND PRIZE: XBOX + KINECT

RU

LE

(40)

[email protected] @wdwebster

http://www.linkedin.com/in/wdanielwebster

http://summit7systems.com/blogs/danielwebster

MCT, MCSE: Security + Internet, MCSA, , MCITP & MCTS: SharePoint 2010

Co-author, Microsoft Office SharePoint Server 2007

Administrator’s Companion

Technical Editor, Microsoft Office SharePoint Server 2007 Best Practices

Co-author, Microsoft SharePoint Server 2010

Administrator’s Pocket Consultant

Contributing author, Microsoft SharePoint Server 2010

Administrator’s Companion

Daniel Webster

Fill out surveys for big prizes