perl-String-Tokenizer - A simple string tokenizer

Property Value
Distribution Mageia 6.1
Repository Mageia Core i586
Package name perl-String-Tokenizer
Package version 0.60.0
Package release 2.mga6
Package architecture noarch
Package type rpm
Installed size 44.22 KB
Download size 26.49 KB
Official Mirror
A simple string tokenizer which takes a string and splits it on whitespace.
It also optionally takes a string of characters to use as delimiters, and
returns them with the token set as well. This allows for splitting the
string in many different ways.
This is a very basic tokenizer, so more complex needs should be either
addressed with a custom written tokenizer or post-processing of the output
generated by this module. Basically, this will not fill everyones needs,
but it spans a gap between simple 'split / /, $string' and the other
options that involve much larger and complex modules.
Also note that this is not a lexical analyser. Many people confuse
tokenization with lexical analysis. A tokenizer mearly splits its input
into specific chunks, a lexical analyzer classifies those chunks. Sometimes
these two steps are combined, but not here.


Package Version Architecture Repository
perl-String-Tokenizer-0.60.0-2.mga6.noarch.rpm 0.60.0 noarch Mageia Core
perl-String-Tokenizer - - -


Name Value
perl >= 0:5.006
perl(constant) -
perl(strict) -
perl(warnings) -
perl-base >= 2:5.22.2


Name Value
perl(String::Tokenizer) == 0.60.0
perl(String::Tokenizer::Iterator) -
perl-String-Tokenizer == 0.60.0-2.mga6


Type URL
Binary Package perl-String-Tokenizer-0.60.0-2.mga6.noarch.rpm
Source Package perl-String-Tokenizer-0.60.0-2.mga6.src.rpm

Install Howto

  1. Enable Mageia Core repository on Install and Remove Software
  2. Update packages list:
    # urpmi.update -a
  3. Install perl-String-Tokenizer rpm package:
    # urpmi perl-String-Tokenizer




2016-06-19 - pterjan <pterjan> 0.60.0-2.mga6
+ Revision: 1033435
- Rebuild for perl 5.22.2
2016-04-15 - shlomif <shlomif> 0.60.0-1.mga6
+ Revision: 1002298
- update to 0.06
2016-02-06 - umeabot <umeabot> 0.50.0-6.mga6
+ Revision: 941134
- Mageia 6 Mass Rebuild
2014-10-15 - umeabot <umeabot> 0.50.0-5.mga5
+ Revision: 739436
- Second Mageia 5 Mass Rebuild
2014-09-16 - umeabot <umeabot> 0.50.0-4.mga5
+ Revision: 686256
- Mageia 5 Mass Rebuild
2013-10-18 - umeabot <umeabot> 0.50.0-3.mga4
+ Revision: 514713
- Mageia 4 Mass Rebuild

See Also

Package Description
perl-String-Trim-0.5.0-7.mga6.noarch.rpm Trim whitespace off your strings
perl-String-Truncate-1.100.602-5.mga6.noarch.rpm A module for when strings are too long to be displayed in
perl-String-Util-1.240.0-3.mga6.noarch.rpm Handy string processing utilities
perl-String-Wildcard-Bash-0.30.0-3.mga6.noarch.rpm Bash wildcard string routines
perl-Struct-Compare-1.0.1-7.mga6.noarch.rpm Recursive diff for perl structures
perl-Struct-Dumb-0.90.0-2.mga6.noarch.rpm Make simple lightweight record-like structures
perl-Sub-Exporter-0.987.0-6.mga6.noarch.rpm A sophisticated exporter for custom-built routines
perl-Sub-Exporter-ForMethods-0.100.52-3.mga6.noarch.rpm Helper routines for using Sub::Exporter to build methods
perl-Sub-Exporter-GlobExporter-0.5.0-2.mga6.noarch.rpm Export shared globs with Sub::Exporter collectors
perl-Sub-Exporter-Progressive-0.1.11-5.mga6.noarch.rpm Only use Sub::Exporter if you need it
perl-Sub-Identify-0.120.0-3.mga6.i586.rpm Retrieve names of code references
perl-Sub-Information-0.100.0-7.mga6.noarch.rpm Get subroutine information
perl-Sub-Install-0.928.0-5.mga6.noarch.rpm Install subroutines into packages easily
perl-Sub-Mage-0.32.0-7.mga6.noarch.rpm Multi-Use utility for manipulating subroutines, classes and more
perl-Sub-Name-0.150.0-2.mga6.i586.rpm Allows to (re)name a sub