aboutsummaryrefslogtreecommitdiffhomepage
path: root/doc_src/tokenize.txt
blob: d0a07465b266d734f448f3e6b2fafb1b4b942ddb (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14

\section tokenize tokenize - tokenize a string

\subsection tokenize-synopsis Synopsis
 <tt>tokenize [STRING...]</tt>

\subsection tokenize-description Description
- STRING is the string or list of strings to tokenize. Each token will be printed on a line by itself
- \c -e, \c --with-empty allow empty tokens
- \c -n, \c --no-empty ignore empty tokens (Default)
- <tt>-d DELIMITER</tt>,  <tt>--delimiter=DELIMITER</tt> is the list of characters that will be used as delimiters. If unspecified, the IFS environment variable will be used as the delimiter string,
- \c -h, \c --help Display help message and exit
- \c -v, \c --version Display version and exit