Token.h File Reference

Defines the token structure (TokenType, TokStream, TokenMap). More...

#include "util/Utilities.h"
#include <cassert>
#include <functional>
#include <list>
#include <map>
#include <memory>
#include <string>

Include dependency graph for Token.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
class	sammine_lang::Token
class	sammine_lang::TokenStream
	A helper class for Lexer to simplify the process of getting a token. More...

Enumerations

enum

TokenType {   TokADD , TokSUB , TokMUL , TokDIV ,   TokMOD , TokAddAssign , TokAddIncr , TokSubAssign ,   TokSubDecr , TokMulAssign , TokDivAssign , TokAND ,   TokAndLogical , TokOR , TokORLogical , TokPipe ,   TokXOR , TokSHL , TokSHR , TokEQUAL ,   TokLESS , TokLessEqual , TokGREATER , TokGreaterEqual ,   TokASSIGN , TokNOT , TokNOTEqual , TokEXP ,   TokFloorDiv , TokCeilDiv , TokLeftParen , TokRightParen ,   TokLeftCurly , TokRightCurly , TokLeftBracket , TokRightBracket ,   TokComma , TokDot , TokSemiColon , TokColon ,   TokDoubleColon , TokReturn , TokFunc , TokStruct ,   TokPtr , TokAlloc , TokFree , TokLen ,   TokArrow , TokLet , TokMUT , TokReuse ,   TokExport , TokImport , TokAs , TokEllipsis ,   TokTypeclass , TokInstance , TokCase , TokFatArrow ,   TokID , TokStr , TokNum , TokTrue ,   TokFalse , TokChar , TokTick , TokIf ,   TokElse , TokWhile , TokType , TokSingleComment ,   TokEOF , TokINVALID }

Detailed Description

Defines the token structure (TokenType, TokStream, TokenMap).