perl-String-Tokenizer - A simple string tokenizer

Property Value
Distribution Mageia Cauldron
Repository Mageia Core x86_64
Package filename perl-String-Tokenizer-0.60.0-3.mga7.noarch.rpm
Package name perl-String-Tokenizer
Package version 0.60.0
Package release 3.mga7
Package architecture noarch
Package type rpm
Category Development/Perl
License GPL+ or Artistic
Maintainer -
Download size 26.55 KB
Installed size 44.25 KB
A simple string tokenizer which takes a string and splits it on whitespace.
It also optionally takes a string of characters to use as delimiters, and
returns them with the token set as well. This allows for splitting the
string in many different ways.
This is a very basic tokenizer, so more complex needs should be either
addressed with a custom written tokenizer or post-processing of the output
generated by this module. Basically, this will not fill everyones needs,
but it spans a gap between simple 'split / /, $string' and the other
options that involve much larger and complex modules.
Also note that this is not a lexical analyser. Many people confuse
tokenization with lexical analysis. A tokenizer mearly splits its input
into specific chunks, a lexical analyzer classifies those chunks. Sometimes
these two steps are combined, but not here.


Package Version Architecture Repository
perl-String-Tokenizer-0.60.0-4.mga8.noarch.rpm 0.60.0 noarch Mageia Core
perl-String-Tokenizer-0.60.0-4.mga8.noarch.rpm 0.60.0 noarch Mageia Core
perl-String-Tokenizer - - -


Name Value
perl >= 0:5.006
perl(constant) -
perl(strict) -
perl(warnings) -
perl-base >= 2:5.28.0


Name Value
perl(String::Tokenizer) == 0.60.0
perl(String::Tokenizer::Iterator) -
perl-String-Tokenizer == 0.60.0-3.mga7


Type URL
Binary Package perl-String-Tokenizer-0.60.0-3.mga7.noarch.rpm
Source Package perl-String-Tokenizer-0.60.0-3.mga7.src.rpm

Install Howto

  1. Enable Mageia Core repository on Install and Remove Software
  2. Update packages list:
    # urpmi.update -a
  3. Install perl-String-Tokenizer rpm package:
    # urpmi perl-String-Tokenizer




2018-09-19 - umeabot <umeabot> 0.60.0-3.mga7
(not released yet)
+ Revision: 1271239
- Mageia 7 Mass Rebuild
2016-06-19 - pterjan <pterjan> 0.60.0-2.mga6
+ Revision: 1033435
- Rebuild for perl 5.22.2
2016-04-15 - shlomif <shlomif> 0.60.0-1.mga6
+ Revision: 1002298
- update to 0.06
2016-02-06 - umeabot <umeabot> 0.50.0-6.mga6
+ Revision: 941134
- Mageia 6 Mass Rebuild

See Also

Package Description
perl-String-Trim-0.5.0-8.mga7.noarch.rpm Trim whitespace off your strings
perl-String-Trim-0.5.0-9.mga8.noarch.rpm Trim whitespace off your strings
perl-String-Truncate-1.100.602-6.mga7.noarch.rpm A module for when strings are too long to be displayed in
perl-String-Truncate-1.100.602-7.mga8.noarch.rpm A module for when strings are too long to be displayed in
perl-String-Util-1.260.0-4.mga8.noarch.rpm Handy string processing utilities
perl-String-Wildcard-Bash-0.43.0-1.mga8.noarch.rpm Bash wildcard string routines
perl-String-Wildcard-Bash-0.43.0-2.mga8.noarch.rpm Bash wildcard string routines
perl-Struct-Compare-1.0.1-8.mga7.noarch.rpm Recursive diff for perl structures
perl-Struct-Compare-1.0.1-9.mga8.noarch.rpm Recursive diff for perl structures
perl-Struct-Dumb-0.90.0-4.mga8.noarch.rpm Make simple lightweight record-like structures
perl-Sub-Exporter-0.987.0-8.mga8.noarch.rpm A sophisticated exporter for custom-built routines
perl-Sub-Exporter-ForMethods-0.100.52-5.mga8.noarch.rpm Helper routines for using Sub::Exporter to build methods
perl-Sub-Exporter-GlobExporter-0.5.0-3.mga7.noarch.rpm Export shared globs with Sub::Exporter collectors
perl-Sub-Exporter-GlobExporter-0.5.0-4.mga8.noarch.rpm Export shared globs with Sub::Exporter collectors
perl-Sub-Exporter-Progressive-0.1.13-3.mga8.noarch.rpm Only use Sub::Exporter if you need it