You can set up categories by defining an initial query and a relevance threshold. You can also include metadata filtering. A category must have at least one search term or at least one metadata expression.
Using the initial query and the given threshold of the document’s relevance percent, Sybase Search assigns a document to the category if its relevance percent is equal to or greater than the threshold.
For example, a query that consists of search terms and a minimum document relevance creates a category of documents that are grouped by their relevance to search terms defined in the given query. The use of the document relevance helps ensure that the documents in the category are valid matches.
Another example is a category query that consists of only metadata, such as “fileType = HTML”. This creates a category that only contains HTML documents.Users can search within a category about a certain subject, such as “England World Cup football.” Or, the user can simply use a category to filter search results, such as searching within a category of HTML documents.
Another way of categorizing documents is based on the content from one or more training documents. In this method, Sybase Search extracts the most relevant content from the training documents and uses this information as a new internal query to generate matching documents. This process is similar to the "find similar" feature except, with category training, relevant content is extracted from more than one document, ensuring that the extracted content is relevant to each of the training documents.
This method has the following benefits:
Categories are created automatically based on example documents and without a base query.
For example, a recruitment company wants to create a category based on a sample Java programmer’s resumé. Without the ability to create category based on category training, the company would need to produce a category "seed" query, which can vary depending on the individual who was creating the category. With training documents, Sybase Search extracts the most relevant content and creates newly training Java programmer category relevant to the example Java programmer’s resumé.
Retrains a category that was originally created using a seed query. Categories can be trained repeatedly on new training documents to achieve the best results.
For example, creating a category using the seed query "football team" can contain documents on English football or American football, depending on the documents that have been indexed by the system. Retraining this category on a few sample documents about American football ensures that the documents in the category are more relevant.
Removes the need for manual tagging and continual maintenance of non-trained categories.
Creating a category
using a base query
Click Document Management. The Document Stores Summary page appears.
Click Categories. The Categories page appears.
Click Create. The Create Category page appears.
In the Category Query Terms field, enter a natural-language query. The more information you provide, the more accurate your results are. For more information, see “Searching across documents”.
In the Not Terms field, enter terms to indicate concepts dissimilar to those for which you are searching. For more information, see “Searching across documents”.
Select the Details tab.
In the Name field, enter a text to distinguish the category from others.
In the Description field, enter text to further describe the category.
Select the Document Groups tab.
From the group list, select one or more document groups to restrict your search.
Select the Metadata tab. To include metadata in the category:
Select a metadata parameter from the metadata list. You can add as many as five metadata parameters to the category. Click Add to add more metadata parameters.
Select an operator. All metadata types support the equal to (=) operator. The integer and date types also support greater than or equal to(>=) and the less than or equal to (<=) operators.
Enter a value for the metadata parameter. Table 6-1 lists the predefined metadata parameters and types.
If the metadata parameter contains a value that consists of more than one term, select the Within expression operator when the metadata parameter contains a value that consists of more than one term.
When you set the operator to AND, every term must be present in the document metadata for the match to succeed. When you set the operator to OR, only one of the terms must be present in the document metadata for the match to succeed.
If you have defined at least two metadata parameters, select the Across Expressions operator. When you set the operator to AND, both metadata parameters must succeed for the match to succeed. When you set the operator to OR, only one of the metadata parameters must succeed.
For more information, see, “Searching across documents”.
Select the Result Options tab. To set up result options:
From the Minimum document relevance list, select a percentage. The percentage you select defines the minimum relevance ranking that a document must score for it to be included within the category. Documents with scores lower than the percentage that you enter are not included.
Select the Score unknown terms check box to specify that terms unknown to the system—which, therefore do not exist in any indexed document—are considered by the scoring algorithm.
Under Training Options, specify the number of results to display per page and the number of paragraphs to display for each document. Select the Term highlighting check box to highlight the query terms in the search results.
The fields under Training Options assist category training
and have no effect on category creation. The values specified in
these fields are not saved during category creation.
Click Create. Sybase Search creates the category, assigns a unique system-generated numeric ID to it, and automatically adds documents that match the category criteria. Sybase Search displays the new category and list of relevant documents on the View Category page.
Creating a category using training documents
Perform steps 1 through 12 of “Creating a category using a base query”.
Click Run Category Query. The search results are displayed in the search results pane. Each search result contains the Add to training documents link.
From the search results, determine the training document that matches the information you are searching and click Add to training documents. Name or title of the specified document appears in the Training documents box. You can add up to five training documents.
Select the Training Documents option.
Click Train Category. The search result displays documents that fall into the category, sorted by relevance.
Click Create. Sybase Search creates the category and returns you to the Categories page.
Creating a category
From the Categories page, determine the category that you want to edit.
Click Edit.
The Edit Category page appears.
Make the required changes. For more information about each category property, see “Creating a category using a base query”.
Click Save. Sybase Search updates the category properties and returns you to the Categories page.
Removing a category
From the Categories page, determine the category that you want to remove.
Click Remove. A message appears, asking you to verify whether to remove the category.
Click OK. Sybase Search removes the category and returns you to the Categories page.
