Compartir a través de


TokenizerResult(String, String, IReadOnlyList<Split>, Boolean) Constructor

Definición

Cree un nuevo objeto del objeto TokenizerResult.

public TokenizerResult(string originalString, string normalizedString, System.Collections.Generic.IReadOnlyList<Microsoft.ML.Tokenizers.Split> splits, bool offsetsMappedToOriginalString);
new Microsoft.ML.Tokenizers.TokenizerResult : string * string * System.Collections.Generic.IReadOnlyList<Microsoft.ML.Tokenizers.Split> * bool -> Microsoft.ML.Tokenizers.TokenizerResult
Public Sub New (originalString As String, normalizedString As String, splits As IReadOnlyList(Of Split), offsetsMappedToOriginalString As Boolean)

Parámetros

originalString
String

Lista de tokens que se van a combinar.

normalizedString
String

Lista de tokens que se van a combinar.

splits
IReadOnlyList<Split>

Lista de tokens que se van a combinar.

offsetsMappedToOriginalString
Boolean

Indica si los desplazamientos se asignan a la cadena original o a la cadena normalizada.

Se aplica a