Code

Added a script to restore punctuation#38

Code

Open

Paul-HenriBJT wants to merge 18 commits intohuggingface:mainhuggingface/dataspeech:mainfrom Paul-HenriBJT:punctuation-scriptPaul-HenriBJT/dataspeech:punctuation-scriptCopy head branch name to clipboard

+274-1

Commits

Commits on Sep 22, 2024

• added a script to restore punctuation

  

  Paul-Henri

  authored and

  Paul-Henri

  committed
  f880b3a

  Copy full SHA for f880b3a

• updated requirements.txt with deepmultilingualpunctuation

  

  Paul-Henri

  authored and

  Paul-Henri

  committed
  3adfe18

  Copy full SHA for 3adfe18

Commits on Oct 2, 2024

• added true casing

  Paul-HenriBJT

  committed
  a3c5501

  Copy full SHA for a3c5501

• updated handling of language

  Paul-HenriBJT

  committed
  d85bd6d

  Copy full SHA for d85bd6d

• updated requirements.txt

  Paul-HenriBJT

  committed
  d25b7d2

  Copy full SHA for d25b7d2

• removed unecessary languages

  Paul-HenriBJT

  committed
  9b7ddb9

  Copy full SHA for 9b7ddb9

• requirements test

  Paul-HenriBJT

  committed
  289212c

  Copy full SHA for 289212c

• requirements test

  Paul-HenriBJT

  committed
  b21b27c

  Copy full SHA for b21b27c

• update requirements

  Paul-HenriBJT

  committed
  c8c447c

  Copy full SHA for c8c447c

• update requirements

  Paul-HenriBJT

  committed
  ba519c8

  Copy full SHA for ba519c8

• update requirements

  Paul-HenriBJT

  committed
  13e314c

  Copy full SHA for 13e314c

• update requirements

  Paul-HenriBJT

  committed
  a1a0e79

  Copy full SHA for a1a0e79

• update requirements

  Paul-HenriBJT

  committed
  e77e9e0

  Copy full SHA for e77e9e0

• Added true casing for 8 languages

  Paul-HenriBJT

  committed
  0d8ed85

  Copy full SHA for 0d8ed85

• added processing of the text_description column

  Paul-HenriBJT

  committed
  018a3d3

  Copy full SHA for 018a3d3

• Merge branch 'casing' into punctuation-script

  Paul-HenriBJT

  committed
  df6e6ed

  Copy full SHA for df6e6ed

Commits on Oct 31, 2024

• moved the dowload of the spacy models inside the restore punctuation script

  Paul-HenriBJT

  committed
  e3bf102

  Copy full SHA for e3bf102

• added num_proc=args.num_proc

  Paul-HenriBJT

  committed
  9156758

  Copy full SHA for 9156758