Udostępnij przez


WordPieceTokenizer.UnknownTokenId Property

Definition

Gets the unknown token ID. A token that is not in the vocabulary cannot be converted to an ID and is set to be this token instead.

public int UnknownTokenId { get; }
member this.UnknownTokenId : int
Public ReadOnly Property UnknownTokenId As Integer

Property Value

Applies to