Package xyz.cofe.text.parse

Class Tokenizer

java.lang.Object
xyz.cofe.text.parse.Tokenizer
All Implemented Interfaces:
java.lang.Iterable<Token>, xyz.cofe.iter.Eterable<Token>
public class Tokenizer
extends java.lang.Object
implements xyz.cofe.iter.Eterable<Token>
Лексический анализатор

  • Constructor Summary

    Constructors 
    Constructor Description
    Tokenizer​(java.lang.String source, int offset, java.lang.Iterable<java.util.function.Function<CharPointer,​? extends Token>> parsers)  
    Tokenizer​(java.lang.String source, int offset, java.util.function.Function<CharPointer,​? extends Token>... parsers)  

  • Method Summary

    Modifier and Type Method Description
    java.util.function.Function<CharPointer,​? extends Token>[] getParsers()  
    CharPointer getPointer()  
    TokenIterator iterator()  
    static Token parse​(java.lang.String source, int offset, java.util.function.Function<? super CharPointer,​? extends Token>... parsers)  
    static Token parse​(java.lang.String source, java.util.function.Function<? super CharPointer,​? extends Token>... parsers)  

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface xyz.cofe.iter.Eterable

    count, filter, first, limit, map, notNull, product, product, product, product, product, toList, union, union

    Methods inherited from interface java.lang.Iterable

    forEach, spliterator

  • Constructor Details

    • Tokenizer

      @SafeVarargs public Tokenizer​(java.lang.String source, int offset, java.util.function.Function<CharPointer,​? extends Token>... parsers)

    • Tokenizer

      public Tokenizer​(java.lang.String source, int offset, java.lang.Iterable<java.util.function.Function<CharPointer,​? extends Token>> parsers)

  • Method Details