Kaydet (Commit) 58177b99 authored tarafından Skip Montanaro's avatar Skip Montanaro

added description of NL token

üst 0bba7f83
......@@ -36,9 +36,12 @@ The scanner is exposed by a single function:
All constants from the \refmodule{token} module are also exported from
\module{tokenize}, as is one additional token type value that might be
\module{tokenize}, as are two additional token type values that might be
passed to the \var{tokeneater} function by \function{tokenize()}:
\begin{datadesc}{COMMENT}
Token value used to indicate a comment.
\end{datadesc}
\begin{datadesc}{NL}
Token value used to indicate a newline.
\end{datadesc}
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment