sammine_lang::TokenStream Class Reference

A helper class for Lexer to simplify the process of getting a token. More...

#include <Token.h>

Public Member Functions
void	setTokenProducer (std::function< void()> producer)
void	push_back (const std::shared_ptr< Token > &token)
bool	hasErrors () const
void	push_back (const Token &token)
void	mark_rollback ()
void	rollback ()
void	rollback (size_t rollback_count)
std::shared_ptr< Token > &	exhaust_until (TokenType tokType)
bool	isEnd ()
std::shared_ptr< Token >	peek ()
std::shared_ptr< Token >	consume ()
sammine_util::Location	currentLocation ()
void	split_current (TokenType first_type, const std::string &first_lex, TokenType second_type, const std::string &second_lex)

Public Attributes
std::vector< std::shared_ptr< Token > >	ErrStream

Detailed Description

A helper class for Lexer to simplify the process of getting a token.

---

The documentation for this class was generated from the following file:

• include/lex/Token.h