1 package Regexp::Wildcards;
6 use Text::Balanced qw/extract_bracketed/;
10 Regexp::Wildcards - Converts wildcard expressions to Perl regular expressions.
18 our $VERSION = '0.06';
22 use Regexp::Wildcards qw/wc2re/;
25 $re = wc2re 'a{b?,c}*' => 'unix'; # Do it Unix style.
26 $re = wc2re 'a?,b*' => 'win32'; # Do it Windows style.
27 $re = wc2re '*{x,y}?' => 'jokers'; # Process the jokers & escape the rest.
28 $re = wc2re '%a_c%' => 'sql'; # Turn SQL wildcards into regexps.
32 In many situations, users may want to specify patterns to match but don't need the full power of regexps. Wildcards make one of those sets of simplified rules. This module converts wildcard expressions to Perl regular expressions, so that you can use them for matching. It handles the C<*> and C<?> shell jokers, as well as Unix bracketed alternatives C<{,}>, but also C<%> and C<_> SQL wildcards. Backspace (C<\>) is used as an escape character. Wrappers are provided to mimic the behaviour of Windows and Unix shells.
36 These variables control if the wildcards jokers and brackets must capture their match. They can be globally set by writing in your program
38 $Regexp::Wildcards::CaptureSingle = 1;
39 # From then, "exactly one" wildcards are capturing
41 or can be locally specified via C<local>
44 local $Regexp::Wildcards::CaptureSingle = 1;
45 # In this block, "exactly one" wildcards are capturing.
48 # Back to the situation from before the block
50 This section describes also how those elements are translated by the L<functions|/FUNCTIONS>.
52 =head2 C<$CaptureSingle>
54 When this variable is true, each occurence of unescaped I<"exactly one"> wildcards (i.e. C<?> jokers or C<_> for SQL wildcards) are made capturing in the resulting regexp (they are be replaced by C<(.)>). Otherwise, they are just replaced by C<.>. Default is the latter.
57 'a???b\\??' is translated to 'a(.)(.)(.)b\\?(.)' if $CaptureSingle is true
58 'a...b\\?.' otherwise (default)
61 'a___b\\__' is translated to 'a(.)(.)(.)b\\_(.)' if $CaptureSingle is true
62 'a...b\\_.' otherwise (default)
66 our $CaptureSingle = 0;
69 return $CaptureSingle ? '(.)'
75 By default this variable is false, and successions of unescaped I<"any"> wildcards (i.e. C<*> jokers or C<%> for SQL wildcards) are replaced by B<one> single C<.*>. When it evalutes to true, those sequences of I<"any"> wildcards are made into B<one> capture, which is greedy (C<(.*)>) for C<$CaptureAny E<gt> 0> and otherwise non-greedy (C<(.*?)>).
78 'a***b\\**' is translated to 'a.*b\\*.*' if $CaptureAny is false (default)
79 'a(.*)b\\*(.*)' if $CaptureAny > 0
80 'a(.*?)b\\*(.*?)' otherwise
83 'a%%%b\\%%' is translated to 'a.*b\\%.*' if $CaptureAny is false (default)
84 'a(.*)b\\%(.*)' if $CaptureAny > 0
85 'a(.*?)b\\%(.*?)' otherwise
92 return $CaptureAny ? (($CaptureAny > 0) ? '(.*)'
97 =head2 C<$CaptureBrackets>
99 If this variable is set to true, valid brackets constructs are made into C<( | )> captures, and otherwise they are replaced by non-capturing alternations (C<(?: | >)), which is the default.
101 'a{b\\},\\{c}' is translated to 'a(b\\}|\\{c)' if $CaptureBrackets is true
102 'a(?:b\\}|\\{c)' otherwise (default)
106 our $CaptureBrackets = 0;
108 sub capture_brackets {
109 return $CaptureBrackets ? '('
115 =head2 C<wc2re_jokers>
117 This function takes as its only argument the wildcard string to process, and returns the corresponding regular expression where the jokers C<?> (I<"exactly one">) and C<*> (I<"any">) have been translated into their regexp equivalents (see L</VARIABLES> for more details). All other unprotected regexp metacharacters are escaped.
119 # Everything is escaped.
120 print 'ok' if wc2re_jokers('{a{b,c}d,e}') eq '\\{a\\{b\\,c\\}d\\,e\\}';
126 $wc =~ s/(?<!\\)((?:\\\\)*[^\w\s?*\\])/\\$1/g;
127 return do_jokers($wc);
132 Similar to the precedent, but for the SQL wildcards C<_> (I<"exactly one">) and C<%> (I<"any">). All other unprotected regexp metacharacters are escaped.
138 $wc =~ s/(?<!\\)((?:\\\\)*[^\w\s%\\])/\\$1/g;
144 This function conforms to standard Unix shell wildcard rules. It successively escapes all unprotected regexp special characters that doesn't hold any meaning for wildcards, turns C<?> and C<*> jokers into their regexp equivalents (see L</wc2re_jokers>), and changes bracketed blocks into (possibly capturing) alternations as described in L</VARIABLES>. If brackets are unbalanced, it tries to substitute as many of them as possible, and then escape the remaining C<{> and C<}>. Commas outside of any bracket-delimited block are also escaped.
146 # This is a valid bracket expression, and is completely translated.
147 print 'ok' if wc2re_unix('{a{b,c}d,e}') eq '(?:a(?:b|c)d|e)';
149 The function handles unbalanced bracket expressions, by escaping everything it can't recognize. For example :
151 # The first comma is replaced, and the remaining brackets and comma are escaped.
152 print 'ok' if wc2re_unix('{a\\{b,c}d,e}') eq '(?:a\\{b|c)d\\,e\\}';
154 # All the brackets and commas are escaped.
155 print 'ok' if wc2re_unix('{a{b,c\\}d,e}') eq '\\{a\\{b\\,c\\}d\\,e\\}';
161 return unless defined $re;
162 $re =~ s/(?<!\\)((?:\\\\)*[^\w\s?*\\\{\},])/\\$1/g;
163 return do_bracketed(do_jokers($re));
166 =head2 C<wc2re_win32>
168 This one works just like the one before, but for Windows wildcards. Bracketed blocks are no longer handled (which means that brackets are escaped), but you can provide a comma-separated list of items.
170 # All the brackets are escaped, and commas are seen as list delimiters.
171 print 'ok' if wc2re_win32('{a{b,c}d,e}') eq '(?:\\{a\\{b|c\\}d|e\\})';
177 return unless defined $wc;
178 $wc =~ s/(?<!\\)((?:\\\\)*[^\w\s?*\\,])/\\$1/g;
179 my $re = do_jokers($wc);
180 if ($re =~ /(?<!\\)(?:\\\\)*,/) { # win32 allows comma-separated lists
181 $re = capture_brackets . do_commas($re) . ')';
188 A generic function that wraps around all the different rules. The first argument is the wildcard expression, and the second one is the type of rules to apply which can be :
192 =item C<'unix'>, C<'win32'>, C<'jokers'>, C<'sql'>
194 For one of those raw rule names, C<wc2re> simply maps to C<wc2re_unix>, C<wc2re_win32>, C<wc2re_jokers> and C<wc2re_sql> respectively.
198 If you supply the Perl operating system name, the call is deferred to C<wc2re_win32> for C< $^O> equal to C<'dos'>, C<'os2'>, C<'MSWin32'> or C<'cygwin'>, and to C<wc2re_unix> in all the other cases.
202 If the type is undefined or not supported, it defaults to C<'unix'>.
204 # Wraps to wc2re_jokers ($re eq 'a\\{b\\,c\\}.*').
205 $re = wc2re 'a{b,c}*' => 'jokers';
207 # Wraps to wc2re_win32 ($re eq '(?:a\\{b|c\\}.*)')
208 # or wc2re_unix ($re eq 'a(?:b|c).*') depending on $^O.
209 $re = wc2re 'a{b,c}*' => $^O;
214 'jokers' => \&wc2re_jokers,
215 'sql' => \&wc2re_sql,
216 'unix' => \&wc2re_unix,
217 map { lc $_ => \&wc2re_win32 } qw/win32 dos os2 MSWin32 cygwin/
221 my ($wc, $type) = @_;
222 return unless defined $wc;
223 $type = $type ? lc $type : 'unix';
224 $type = 'unix' unless exists $types{$type};
225 return $types{$type}($wc);
230 These five functions are exported only on request : C<wc2re>, C<wc2re_unix>, C<wc2re_win32>, C<wc2re_jokers> and C<wc2re_sql>. The variables are not exported.
234 use base qw/Exporter/;
237 our @EXPORT_OK = ('wc2re', map { 'wc2re_'.$_ } keys %types);
238 our @EXPORT_FAIL = qw/extract/,
239 (map { 'do_'.$_ } qw/jokers sql commas brackets bracketed/),
240 (map { 'capture_'.$_ } qw/single any brackets/);
241 our %EXPORT_TAGS = ( all => [ @EXPORT_OK ] );
245 L<Text::Balanced>, which is bundled with perl since version 5.7.3
249 This module does not implement the strange behaviours of Windows shell that result from the special handling of the three last characters (for the file extension). For example, Windows XP shell matches C<*a> like C<.*a>, C<*a?> like C<.*a.?>, C<*a??> like C<.*a.{0,2}> and so on.
253 Some modules provide incomplete alternatives as helper functions :
255 L<Net::FTPServer> has a method for that. Only jokers are translated, and escaping won't preserve them.
257 L<File::Find::Match::Util> has a C<wildcard> function that compiles a matcher. It only handles C<*>.
259 L<Text::Buffer> has the C<convertWildcardToRegex> class method that handles jokers.
263 Vincent Pit, C<< <perl at profvince.com> >>
267 Please report any bugs or feature requests to
268 C<bug-regexp-wildcards at rt.cpan.org>, or through the web interface at
269 L<http://rt.cpan.org/NoAuth/ReportBug.html?Queue=Regexp-Wildcards>.
270 I will be notified, and then you'll automatically be notified of progress on
271 your bug as I make changes.
275 You can find documentation for this module with the perldoc command.
277 perldoc Regexp::Wildcards
279 =head1 COPYRIGHT & LICENSE
281 Copyright 2007 Vincent Pit, all rights reserved.
283 This program is free software; you can redistribute it and/or modify it
284 under the same terms as Perl itself.
288 sub extract { extract_bracketed shift, '{', qr/.*?(?<!\\)(?:\\\\)*(?={)/; }
292 # escape an odd number of \ that doesn't protect a regexp/wildcard special char
293 s/(?<!\\)((?:\\\\)*\\(?:[\w\s]|$))/\\$1/g;
294 # substitute ? preceded by an even number of \
295 my $s = capture_single;
296 s/(?<!\\)((?:\\\\)*)\?/$1$s/g;
297 # substitute * preceded by an even number of \
299 s/(?<!\\)((?:\\\\)*)\*+/$1$s/g;
305 # escape an odd number of \ that doesn't protect a regexp/wildcard special char
306 s/(?<!\\)((?:\\\\)*\\(?:[^\W_]|\s|$))/\\$1/g;
307 # substitute _ preceded by an even number of \
308 my $s = capture_single;
309 s/(?<!\\)((?:\\\\)*)_/$1$s/g;
310 # substitute * preceded by an even number of \
312 s/(?<!\\)((?:\\\\)*)%+/$1$s/g;
318 # substitute , preceded by an even number of \
319 s/(?<!\\)((?:\\\\)*),/$1|/g;
325 substr $rest, 0, 1, '';
327 my ($re, $bracket, $prefix) = ('');
328 while (($bracket, $rest, $prefix) = extract $rest and $bracket) {
329 $re .= do_commas($prefix) . do_brackets($bracket);
331 $re .= do_commas($rest);
332 return capture_brackets . $re . ')';
337 my ($re, $bracket, $prefix) = ('');
338 while (($bracket, $rest, $prefix) = extract $rest and $bracket) {
339 $re .= $prefix . do_brackets($bracket);
342 $re =~ s/(?<!\\)((?:\\\\)*[\{\},])/\\$1/g;
346 1; # End of Regexp::Wildcards