Share via

Tokenizer<TSymbol,TSymbolType> Class

Definition

Namespace:
Microsoft.AspNetCore.Razor.Tokenizer
Assembly:
Microsoft.AspNetCore.Razor.dll
Package:
Microsoft.AspNetCore.Razor v1.0.0
Package:
Microsoft.AspNetCore.Razor v1.1.0
generic <typename TSymbol, typename TSymbolType>
 where TSymbol : SymbolBase<TSymbolType> where TSymbolType : value classpublic ref class Tokenizer abstract : Microsoft::AspNetCore::Razor::Tokenizer::ITokenizer
public abstract class Tokenizer<TSymbol,TSymbolType> : Microsoft.AspNetCore.Razor.Tokenizer.ITokenizer where TSymbol : SymbolBase<TSymbolType> where TSymbolType : struct
type Tokenizer<'Symbol, 'SymbolType (requires 'Symbol :> SymbolBase<'SymbolType> and 'SymbolType : struct)> = class
    interface ITokenizer
Public MustInherit Class Tokenizer(Of TSymbol, TSymbolType)
Implements ITokenizer

Type Parameters

TSymbol
TSymbolType
Inheritance
Object
Tokenizer<TSymbol,TSymbolType>
Implements
ITokenizer

Constructors

Name Description
Tokenizer<TSymbol,TSymbolType>(ITextDocument)

Properties

Name Description
Buffer
CurrentCharacter
CurrentErrors
CurrentLocation
CurrentStart
CurrentState
CurrentSymbol
EndOfFile
HaveContent
RazorCommentStarType
RazorCommentTransitionType
RazorCommentType
Source
StartState

Methods

Name Description
AfterRazorCommentTransition()
AtSymbolAfterRazorCommentBody()
CreateSymbol(SourceLocation, String, TSymbolType, IReadOnlyList<RazorError>)
Dispatch()
EndSymbol(SourceLocation, TSymbolType)
EndSymbol(TSymbolType)
MoveNext()
NextSymbol()
Peek()
RazorCommentBody()
Reset()
Single(TSymbolType)
StarAfterRazorCommentBody()
StartSymbol()
Stay()

Returns a result indicating that this state has no output and the machine should remain in this state
Stay(TSymbol)

Returns a result containing the specified output and indicating that the next call to Turn() should re-invoke the current state.
Stop()

Returns a result indicating that the machine should stop executing and return null output.
TakeAll(String, Boolean)
TakeCurrent()
TakeUntil(Func<Char,Boolean>)
Transition(Int32, TSymbol)

Returns a result containing the specified output and indicating that the next call to Turn() should invoke the provided state.
Transition(Int32)

Returns a result indicating that this state has no output and the machine should immediately invoke the specified state
Transition(Tokenizer<TSymbol,TSymbolType>.RazorCommentTokenizerState, TSymbol)
Transition(Tokenizer<TSymbol,TSymbolType>.RazorCommentTokenizerState)
Turn()

Explicit Interface Implementations

Name Description
ITokenizer.NextSymbol()

Applies to