PyThaiNLP v5.1.0 Released!

[wannaphong]

We released PyThaiNLP v5.1.0! This version has increased features and fixed problems such as Thai Discourse Treebank (TDTB), Thai Solar Date converted to Thai Lunar Date, and others.

Install: pip install pythainlp
Upgrade: pip install -U pythainlp

• Documentation: https://pythainlp.github.io/docs/5.1
• Report bug: https://github.com/PyThaiNLP/pythainlp/issues

See PyThaiNLP 5.1 Change Log: #900

What is new?

New features

• Add Thai Discourse Treebank postag Add Thai Discourse Treebank postag #910
• Add Thai Universal Dependency Treebank postag Add Thai Universal Dependency Treebank postag #916
• Add Thai G2P v2 Grapheme-to-Phoneme model Add Thai G2P v2 Grapheme-to-Phoneme model #923
• Add support for list of strings as input to sent_tokenize() Add support for list of strings as input to sent_tokenize() #927
• Add pythainlp.tools.safe_print to handle UnicodeEncodeError on console Add pythainlp.tools.safe_print to handle UnicodeEncodeError on console #969
• Add Thai Solar Date convert to Thai Lunar Date Add Thai Solar Date convert to Thai Lunar Date #998
• Add Thai pangram text Add Thai pangram text #1045

Bug fixes

• Fix collate() to consider tonemark in ordering Fix collate() to consider tonemark in ordering #926
• Fix maiyamok() that expanding the wrong word Fix maiyamok() that expanding the wrong word #962
• Fix nlpo3.load_dict() that never print error msg when not success Fix nlpo3.load_dict() that never print error msg when not success #979

Remove

• Remove clause_tokenize Remove clause_tokenize #1024

Deprecation and other API changes

• 5.1
  • pythainlp.util.is_native_thai, use instead pythainlp.morpheme.is_native_thai
• 5.2
  • pythainlp.cls, use instead pythainlp.classify
  • pythainlp.corpus.thai_synonym, use instead pythainlp.corpus.thai_synonyms
  • pythainlp.util.maiyamok, use instead pythainlp.util.expand_maiyamok

Improve

• Add more Thailand political party to Thai dictionary 2252dee
• Fix inconsistency in newmm-safe engine by copilot Fix inconsistency in newmm-safe engine by copilot #1063
• Update warn_deprecation to get deprecated and removal versions Update warn_deprecation to get deprecated and removal versions #1028
• Remove unnecessary enumerate in expand_maiyamok Remove unnecessary enumerate in expand_maiyamok #1029
• Add SPDX FileType Add SPDX FileType #1032
• Fix bug in Longest Matching tokenizer to preprocess spaces consistently Fix bug in Longest Matching tokenizer to preprocess spaces consistently #1062
• Add codemeta.json file to root directory Add codemeta.json file to root directory #1053

Full Changelog: v5.0.0...v5.1.0

Contributors

Thanks all the contributors. (Image made with contributors-img)

We build Thai NLP.

PyThaiNLP

[wannaphong]

News: PyThaiNLP/pythainlp.github.io#1

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[wannaphong]

Add 5.1 docs PyThaiNLP/docs#1