Skip to content

Commit

Permalink
Minor documentation fixes
Browse files Browse the repository at this point in the history
  • Loading branch information
osubboo committed Jun 11, 2024
1 parent d86110f commit 7de00a2
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions groups/bdl/bdlb/bdlb_tokenizer.h
Original file line number Diff line number Diff line change
Expand Up @@ -41,14 +41,14 @@ BSLS_IDENT("$Id: $")
//
// Soft delimiters are used in applications where multiple consecutive
// delimiter characters are to be treated as just a single delimiter. For
// example, if we want the input string '"Sticks and stones"' to parse into a
// example, if we want the input string ' "Sticks and stones" ' to parse into a
// sequence of three non-empty tokens ["Sticks", "and", "stones"], rather than
// the four-token sequence ["Sticks", "", "and", "stones"], we would make the
// space (' ') a soft-delimiter character.
//
// Hard delimiters are used in applications where consecutive delimiter
// characters are to be treated as separate delimiters, giving rise to the
// possibility of empty tokens. Making the slash ('/') in the standard date
// possibility of empty tokens. Making the slash ( '/' ) in the standard date
// format a hard delimiter for the input string "15//9" yields the three-token
// sequence ["15", "", "9"], rather than the two-token one ["15", "9"] had it
// been made soft.
Expand Down Expand Up @@ -87,8 +87,8 @@ BSLS_IDENT("$Id: $")
// Parsing is from left to right and is *greedy* -- i.e., the longest sequence
// satisfying the regular expression is the one that matches. For example, let
// 's' represent the start of a soft delimiter, 'd' the start of a hard
// delimiter, '^" the start of a token, and '~' the continuation of that same
// delimiter or token. Using '.' as a soft delimiter and "/" as a hard one,
// delimiter, '^' the start of a token, and '~' the continuation of that same
// delimiter or token. Using '.' as a soft delimiter and '/' as a hard one,
// the string
//..
// s~ h~ h~~ h~ s~ hh s h~h h~~~ Delimiters
Expand All @@ -105,7 +105,7 @@ BSLS_IDENT("$Id: $")
//
// (..) (/.) (./.) (./) (..) (/)(/) (.) (/.)(/) (./..) Delims
//..
// Notice that in pair of hard delimiters "/./" before the token "sea", the
// Notice that in pair of hard delimiters '/./' before the token "sea", the
// soft token character between the two hard ones binds to the earlier
// delimiter.
//
Expand Down

0 comments on commit 7de00a2

Please sign in to comment.