book

Working with Microsoft® FAST™ Search Server 2010 for SharePoint®

Name: Working with Microsoft® FAST™ Search Server 2010 for SharePoint®
Author: Marcus Johansson Mikael Svenson and Robert Piddocke
ISBN: 9780735671430

by Marcus Johansson Mikael Svenson and Robert Piddocke

March 2012

Intermediate to advanced

486 pages

13h

English

Microsoft Press

Read now

Unlock full access

Foreword
Introduction
Who Should Read This BookAssumptionsWho Should Not Read This BookOrganization of This BookFinding Your Best Starting Point in This BookConventions and Features in This BookSystem RequirementsCode SamplesInstalling the Code SamplesUsing the Code SamplesAcknowledgments from All the AuthorsMikael Svenson’s AcknowledgmentsMarcus Johansson’s AcknowledgmentsRobert Piddocke’s AcknowledgmentsErrata & Book SupportWe Want to Hear from YouStay in Touch
I. What You Need to Know
1. Introduction to FAST Search Server 2010 for SharePoint
What Is FAST?PastPresentFutureVersionsFSISCTS, IMS, and FAST Search DesignerSearch Business Manager and IMS UI ToolkitFSIAFS4SPSharePoint Search vs. Search Server Versions, and FS4SPFeatures at a GlanceScalabilityExplanation of FeaturesItem ProcessingDocument Processing/Format ConversionProperty ExtractionAdvanced Query Language (FQL)Duplicate CollapsingLinguisticsRefinersWhat Should I Choose?Evaluating Search NeedsEnvironmentHow many users do you have and how often do you expect each one to search?What type of and how much content do you have?How can you make your users take action on the search results?Where are you coming from and where do you want to go?How skilled are your users at searching?CorpusHow much content do you have to search?Does everything need to be searchable?Are there multiple content sources?How much and in what divisions is the different content being consumed?ContentWhat is the quality of the content?Is there rich metadata?What document types are there?OrganizationDoes the content have an existing organization (taxonomy, site structure)?How difficult is it to navigate to the most relevant content vs. search?Decision FlowchartFeatures ScorecardCost EstimatorConclusion
2. Search Concepts and Terminology
OverviewRelevancyRecall and PrecisionQuery ExpansionCorpusRank TuningStatic rank tuningDynamic rank tuningLinguisticsTokenizationKeyword rankRank ProfilesSharePoint ComponentsWeb Front EndCentral AdministrationSearch Service ApplicationsFederated Search Object ModelQuery Web ServiceQuery RSS FeedQuery Object ModelWeb PartsPeople SearchContent ProcessingContent SourcesCrawling and IndexingIndexingFederated SearchDocument ProcessorFIXMLIndexing DispatcherMetadataIndex SchemaQuery ProcessingQR ServerRefiners (Faceted Search)Query LanguageToken ExpressionsProperty SpecificationsBoolean OperatorsSearch ScopesSecurity TrimmingClaims-Based AuthenticationConclusion
3. FS4SP Architecture
OverviewServer Roles and ComponentsFS4SP ArchitectureSharePoint Search Service ApplicationsFAST Search Connector (FAST Content SSA)FAST Search Query (FAST Query SSA)Crawl Components and Crawl DatabasesSearch Rows, Columns, and ClustersScenarioFS4SP Index ServersFS4SP Query Result Servers/QR ServerConclusion
4. Deployment
OverviewHardware RequirementsStorage ConsiderationsDisk SpeedDisk LayoutUsing a SANUsing NASUsing SSDFS4SP and VirtualizationSoftware RequirementsInstallation GuidelinesBefore You StartSoftware PrerequisitesFS4SP Preinstallation ConfigurationFS4SP Update InstallationFS4SP Slipstream InstallationSingle-Server FS4SP Farm ConfigurationDeployment ConfigurationMulti-Server FS4SP Farm ConfigurationManual and Automatic Synchronization of Configuration ChangesCertificates and SecurityCreating FAST Content SSAs and FAST Query SSAsEnabling Queries from SharePoint to FS4SPCreating a Search CenterScripted InstallationAdvanced Filter PackIFilterReplacing the Existing SharePoint Search with FS4SPDevelopment EnvironmentsSingle-Server Farm SetupMulti-Server Farm SetupPhysical MachinesVirtual MachinesBooting from a VHDProduction EnvironmentsContent VolumeFailover and High AvailabilityQuery ThroughputFreshnessDisk SizingServer Load Bottleneck PlanningConclusion
5. Operations
Introduction to FS4SP OperationsAdministration in SharePointAdministration in Windows PowerShellOther Means of AdministrationUsing Configuration FilesUsing Command-Line ToolsBasic OperationsThe Node ControllerStarting and Stopping a Single-Server InstallationStarting and Stopping a Multi-Server InstallationStarting and Stopping Internal ProcessesRelationship Between the Node Controller and the FS4SP Windows ServicesAdding and Removing Document ProcessorsA Note on Node Controller InternalsIndexer AdministrationSuspending and Resuming Indexing OperationsRebuilding a Corrupt IndexSearch AdministrationSearch Click-Through AnalysisChecking the Status of SPRelReconfiguring SPRelLink AnalysisChecking the Status of the Web AnalyzerForcing the Web Analyzer to RunListing the Relevance Data for a Specific ItemServer Topology ManagementModifying the Topology on the FS4SP FarmAdding One or More Index Columns Without RecrawlingModifying the Topology on the SharePoint FarmChanging the Location of Data and Log FilesLoggingGeneral-Purpose LogsWindows Event LogsSharePoint Unified Logging Service (ULS)Internal FS4SP LogsFunctional LogsItem Processing LoggingInspect runtime statisticsTurn on debug and tracing for the running document processorsInspect crawled properties in the indexing pipeline by using FFDDumperCrawl LoggingQuery LoggingPerformance MonitoringIdentifying Whether an FS4SP Farm Is an Indexing BottleneckIdentifying Whether the Document Processors Are the Indexing BottleneckIdentifying Whether Your Disk Subsystem Is a BottleneckBackup and RecoveryPrerequisitesBackup and Restore ConfigurationPerforming a Configuration BackupPerforming a Configuration RestoreFull Backup and RestorePerforming a Full BackupPerforming a Full RestoreIncremental BackupSpeeding Up BackupsConclusion
II. Creating Search Solutions
6. Search Configuration
Overview of FS4SP ConfigurationSharePoint AdministrationWindows PowerShell AdministrationCode AdministrationCode Example AssumptionsOther Means of AdministrationIndex Schema ManagementThe Index SchemaCrawled and Managed PropertiesSharePointWindows PowerShell.NETFull-Text Indexes and Rank ProfilesSharePointWindows PowerShell.NETManaged Property BoostsWindows PowerShell.NETStatic Rank ComponentsWindows PowerShellCollection ManagementWindows PowerShell.NETScope ManagementSharePointWindows PowerShell.NETProperty Extraction ManagementBuilt-in Property ExtractionSharePointWindows PowerShell.NETKeyword, Synonym, and Best Bet ManagementKeywordsSharePointWindows PowerShell.NETSite Promotions and DemotionsSharePointWindows PowerShell.NETFQL-Based PromotionsWindows PowerShellUser Context ManagementSharePointWindows PowerShellAdding More Properties to User ContextsConclusion

7. Content Processing
IntroductionCrawling Source SystemsCrawling Content by Using the SharePoint Built-in ConnectorsContent Source TypesSharePoint sitesWeb SitesFile SharesExchange Public FoldersBCSCustom RepositoryDocumentumLotus NotesCrawl Rules ManagementCrawler Impact Rules ManagementCrawling Content by Using the FAST Search Specific ConnectorsOther FAST Search Specific Functionality for Indexing ContentThe Content APIThe docpush command-line toolFAST Search Web CrawlerBasic operationsCrawl configurationCrawled propertiesFAST Search Database ConnectorBasic operationsCrawl configurationCrawled propertiesFAST Search Lotus Notes ConnectorBasic operationsCrawl configurationCrawled propertiesChoosing a ConnectorItem ProcessingUnderstanding the Indexing PipelineOptional Item ProcessingThe OptionalProcessing.xml Configuration FileBuilt-in Property ExtractionPerson namesLocationsCompaniesCustom Property ExtractionCustom XML Item ProcessingOffensive Content FilteringDebugging Item ProcessingExtended Metadata Extraction of Word and PowerPoint DocumentsDocument ConversionIntegrating an External Item Processing ComponentConfigurationDeveloping an External Item Processing ComponentThe Mythical PEWS FrameworkConclusion
8. Querying the Index
IntroductionQuery LanguagesKeyword Query SyntaxFQLOverviewUsageField/Scope specificationWildcard expressionsReserved words and charactersSimple Query LanguageXRANKExamplesSearch Center and RSS URL SyntaxSearch APIsQuerying a QR Server DirectlyFederated Search Object ModelSharedQueryManager and QueryManagerLocationListLocationFASTSearchRuntimeExecuting a Query by Using QueryManager, LocationList, and LocationGetting the Correct Total When Using Duplicate TrimmingExecuting a Query by Using FASTSearchRuntimeQuery Object ModelKeyword QueryExecuting a Query by Using the KeywordQuery ClassExecuting a Query by Using FQL with the KeywordQuery ClassQuery Web ServiceExecuting a Query by Using the Query Web ServiceQuery via RSSChoosing Which API to UseConclusion
9. Useful Tips and Tricks
Searching Inside Nondefault File FormatsInstalling Third-Party IFiltersExtending the Expiration Date of the FS4SP Self-Signed CertificateReplacing the Default FS4SP Certificate with a Windows Server CA CertificateRemoving the FAST Search Web CrawlerUpgrading from SharePoint Search to FS4SPReducing the Downtime When Migrating from SharePoint Search to FS4SPImproving the Built-in Duplicate Removal FeatureReturning All Text for an Indexed ItemExecuting Wildcard Queries Supported by FQLGetting Relevancy with WildcardsDebugging an External Item Processing ComponentInspecting Crawled Properties by Using the Spy ProcessorUsing the Visual Studio Debugger to Debug a Live External Item Processing ComponentUsing the Content of an Item in an External Item Processing ComponentCreating an FQL-Enabled Core Results Web PartCreating a Refinement Parameter by Using CodeImproving Query SuggestionsAdding, Removing, and Blocking Query SuggestionsSecurity Trimming Search SuggestionsDisplaying Actual Results Instead of SuggestionsCreating a Custom Search Box and Search Suggestion Web ServicePreventing an Item from Being IndexedUsing List, Library, and Site Permission to Exclude ContentUsing Crawl RulesCreating Custom Business RulesCreating a Custom Property Extractor Dictionary Based on a SharePoint ListCrawling a Password-Protected Site with the FAST Search Web CrawlerConfiguring the FAST Search Database Connector to Detect Database ChangesConclusion
10. Search Scenarios
Productivity SearchIntroduction to Productivity SearchContoso Productivity SearchSetting Up a Search CenterSetting Up Department User ContextCreating a Department RefinerPromoting Items for Coworkers by Using an FQL-Enabled Web PartPromoting Items for Coworkers by Using Predefined ScopesDemoting Site Collection Root and Site HomeAdding a Products RefinerUsing Visual Best Bets to Redirect to a Landing PageAdding Relevant Documents to a Page by Using Enterprise KeywordsProductivity Search Example Wrap-UpE-Commerce SearchIntroduction to E-Commerce SearchAdventure Works E-CommerceSetting Up an External Content Type for IndexingSetting Up a New Content SourceDefining Properties, Full-Text Index, and Rank ProfileSetting Up a Basic Search StorefrontPromoting High-Margin ProductsAlternative 1: Extend the Search Core Results Web Part with formula sortAlternative 2: Add the product margin as a static rank componentSetting Up a Price Refiner Conditional on the Product LanguagePromoting ItemsMultiple Search Setting GroupsE-Commerce Example Wrap-Up
A. About the Authors
Index
About the Authors
Copyright

Overview

Build robust, scalable search solutions to fit the way your business works

Deliver powerful search tools to your clients—using Microsoft FAST Search Server 2010 for SharePoint. Led by three search experts, you’ll learn how to deliver advanced intranet search capabilities and build custom, search-driven applications for your business. Use your skills as a SharePoint architect or developer to configure and program this server for different search scenarios, based on real-world examples.

Discover how to:

Integrate FAST Search Server for SharePoint into your existing SharePoint architecture

Use best practices to develop solutions specific to your business

Enable users to search millions of SharePoint documents efficiently

Master powerful indexing and data modification techniques

Expand document processing capabilities to handle data more effectively

Develop custom search applications and web parts

Configure your server for current content volume, and plan for future expansion

Manage search operations and monitor performance directly from SharePoint

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Professional Microsoft® Search: FAST Search, SharePoint® Search, and Search Server

Publisher Resources

ISBN: 9780735671430Purchase book

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills