BertTokenizer.Create Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Overloads
| Create(Stream, BertOptions) |
Create a new instance of the BertTokenizer class. |
| Create(String, BertOptions) |
Create a new instance of the BertTokenizer class. |
Create(Stream, BertOptions)
- Source:
- BertTokenizer.cs
- Source:
- BertTokenizer.cs
- Source:
- BertTokenizer.cs
Create a new instance of the BertTokenizer class.
public static Microsoft.ML.Tokenizers.BertTokenizer Create(System.IO.Stream vocabStream, Microsoft.ML.Tokenizers.BertOptions? options = default);static member Create : System.IO.Stream * Microsoft.ML.Tokenizers.BertOptions -> Microsoft.ML.Tokenizers.BertTokenizerPublic Shared Function Create (vocabStream As Stream, Optional options As BertOptions = Nothing) As BertTokenizerParameters
- vocabStream
- Stream
The stream containing the vocabulary file.
- options
- BertOptions
The options to use for the Bert tokenizer.
Returns
A new instance of the BertTokenizer class.
Remarks
When creating the tokenizer, ensure that the vocabulary stream is sourced from a trusted provider.
Applies to
Create(String, BertOptions)
- Source:
- BertTokenizer.cs
- Source:
- BertTokenizer.cs
- Source:
- BertTokenizer.cs
Create a new instance of the BertTokenizer class.
public static Microsoft.ML.Tokenizers.BertTokenizer Create(string vocabFilePath, Microsoft.ML.Tokenizers.BertOptions? options = default);static member Create : string * Microsoft.ML.Tokenizers.BertOptions -> Microsoft.ML.Tokenizers.BertTokenizerPublic Shared Function Create (vocabFilePath As String, Optional options As BertOptions = Nothing) As BertTokenizerParameters
- vocabFilePath
- String
The path to the vocabulary file.
- options
- BertOptions
The options to use for the Bert tokenizer.
Returns
A new instance of the BertTokenizer class.
Remarks
When creating the tokenizer, ensure that the vocabulary file is sourced from a trusted provider.