|  | Tokenizer Methods | 
The Tokenizer type exposes the following members.
 Methods
Methods| Name | Description | |
|---|---|---|
|  | Equals | Determines whether the specified object is equal to the current object.(Inherited from Object.) | 
|  | Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.(Inherited from Object.) | 
|  | GetHashCode | Serves as the default hash function. (Inherited from Object.) | 
|  | GetType | Gets the Type of the current instance.(Inherited from Object.) | 
|  | Matches(String) | 
            Determines whether the given pattern matches the value at the current
            position of the tokenizer.
             | 
|  | Matches(String) | 
            Determines whether any of the given patterns match the value at the current
            position of the tokenizer.
             | 
|  | MemberwiseClone | Creates a shallow copy of the current Object.(Inherited from Object.) | 
|  | Peek | 
            Retrieves the next character in the tokenizer without advancing its position.
             | 
|  | Pop | 
            Removes an index from the tokenizer's bookkeeping stack. 
             | 
|  | PullWhitespace | 
            Advances the tokenizer to the next non-whitespace character.
             | 
|  | Push | 
            Adds the current index to the tokenizer's bookkeeping stack.
             | 
|  | Take | 
            Retrieves the next character in the tokenizer.
             | 
|  | Take(Int32) | 
            Retrieves a string of the given length from the current position of the tokenizer.
             | 
|  | ToString | Returns a string that represents the current object.(Inherited from Object.) | 
 Extension Methods
Extension Methods| Name | Description | |
|---|---|---|
|  | AsInstanceOfT | 
            TBD
            (Defined by Extensions.) | 
|  | Match | Overloaded. 
            Matches the specified target.
            (Defined by PatternMatch.) | 
|  | MatchT | Overloaded. 
            Matches the specified target and return a result of target processing.
            (Defined by PatternMatch.) | 
 See Also
See Also