rnix
0.11.0
In rnix::tokenizer
?
Settings
Function
rnix
::
tokenizer
::
tokenize
Copy item path
source
·
[
−
]
pub fn tokenize(input: &
str
) ->
Vec
<
Token
<'_>>
Expand description
A convenience function for tokenizing the given input