Interface EncodedTokensProvider

A "manual" provider of tokens, returning tokens in a binary form.

interface EncodedTokensProvider {
    getInitialState(): IState;
    tokenize?(line: string, state: IState): ILineTokens;
    tokenizeEncoded(line: string, state: IState): IEncodedLineTokens;
}

Index

Methods

getInitialState tokenize? tokenizeEncoded

Methods

getInitialState

getInitialState(): IState
The initial state of a language. Will be the state passed in to tokenize the first line.

Returns IState
- Defined in src/components/monaco/bin/monaco.d.ts:6673

`Optional`tokenize

tokenize?(line: string, state: IState): ILineTokens
Tokenize a line given the state at the beginning of the line.
Parameters
- line: string
- state: IState
Returns ILineTokens
- Defined in src/components/monaco/bin/monaco.d.ts:6681

tokenizeEncoded

tokenizeEncoded(line: string, state: IState): IEncodedLineTokens
Tokenize a line given the state at the beginning of the line.
Parameters
- line: string
- state: IState
Returns IEncodedLineTokens
- Defined in src/components/monaco/bin/monaco.d.ts:6677