In this article, we’re gonna implement the PROPLexAnalyzer::getToken() that allows us to determine types of words from a file to compile them to following processes in the PROPCompiler. The next step it’s a Syntax Analyzer that we’ll discuss in further videos.
Imagine the following rules:
Blog_Post -> More_Work!
#Actually it doesn't matter, I enjoy it!!
The getToken() function returns Blog_Post as a ID, -> as a operation, More_Work! as another ID and any line preceded by # as a comment.
In the next video, we’re showing the implementation of this function: