SearchModelFactory.PatternTokenizer Method

Definition

Tokenizer that uses regex pattern matching to construct distinct tokens. This tokenizer is implemented using Apache Lucene.

public static Azure.Search.Documents.Indexes.Models.PatternTokenizer PatternTokenizer(string name = default, string pattern = default, string flagsInternal = default, int? group = default);
static member PatternTokenizer : string * string * string * Nullable<int> -> Azure.Search.Documents.Indexes.Models.PatternTokenizer
Public Shared Function PatternTokenizer (Optional name As String = Nothing, Optional pattern As String = Nothing, Optional flagsInternal As String = Nothing, Optional group As Nullable(Of Integer) = Nothing) As PatternTokenizer

Parameters

name
String

The name of the tokenizer. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters.

pattern
String

A regular expression pattern to match token separators. Default is an expression that matches one or more non-word characters.

flagsInternal
String

Regular expression flags, specified as a '|' separated string of RegexFlags values.

group
Nullable<Int32>

The zero-based ordinal of the matching group in the regular expression pattern to extract into tokens. Use -1 if you want to use the entire pattern to split the input into tokens, irrespective of matching groups. Default is -1.

Returns

A new PatternTokenizer instance for mocking.

Applies to