Search Results for "chinese word segmentation"
Sort By:
Showing 159 open source projects for "chinese word segmentation"
View related business solutions-
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
gse
Go efficient multilingual NLP and text segmentation
Go efficient multilingual NLP and text segmentation; support English, Chinese, Japanese and others. Gse is implements jieba by golang, and try add NLP support and more feature. Support common, search engine, full mode, precise mode and HMM mode multiple word segmentation modes. Support user and embed dictionary, Part-of-speech/POS tagging, analyze segment info, stop and trim words. -
2
ZhParser
PostgreSQL extension for full-text search of Chinese language
zhparser is a PostgreSQL extension for full-text search of Chinese text. It integrates with PostgreSQL's text search engine to tokenize Chinese characters using a dictionary-based segmentation algorithm. zhparser is a valuable tool for improving search accuracy and performance in Chinese-language applications. -
3
Riot search
Go Open Source, Distributed, Simple and efficient Search Engine
Go Open Source, Distributed, Simple and efficient full text search engine. Efficient indexing and search (1M blog 500M data 28 seconds index finished, 1.65 ms search response time, 19K search QPS). Support for logical search. Support Chinese word segmentation (use gse word segmentation package concurrent word, speed 27MB / s). Support the calculation of the keyword in the text close to the distance（token proximity). Support calculation BM25 correlation. Support custom scoring field and scoring rules. Support add online, delete index. Support heartbeat. Support multiple persistent storage. ... -
4
HanLP
Han Language Processing
...Built on TensorFlow 2.0, it was designed to advance state-of-the-art deep learning techniques and popularize the application of natural language processing in both academia and industry. HanLP is capable of lexical analysis (Chinese word segmentation, part-of-speech tagging, named entity recognition), syntax analysis, text classification, and sentiment analysis. It comes with pretrained models for numerous languages including Chinese and English. It offers efficient performance, clear structure and customizable features, with plenty more amazing features to look forward to on the roadmap. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
Introduction-NLP
Detailed notes on HanLP's new book, "Introduction to Natural Language"
Introduction NLP is a Chinese-language study-notes repository based on the book Introduction to Natural Language Processing by the author of HanLP. It explains NLP concepts in accessible language while pairing theory with practical implementation notes. The material begins with basic concepts and Chinese word segmentation before progressing into statistical sequence models. -
6
Underthesea
Underthesea - Vietnamese NLP Toolkit
Underthesea is a Vietnamese NLP toolkit providing various text processing capabilities, including word segmentation, part-of-speech tagging, and named entity recognition. -
7
Dawarich
Self-hostable alternative to Google Timeline
Dawarich is a command-line tool (likely Ruby-based) for transforming and analyzing Arabic text data with normalization, diacritic handling, segmentation, and morphological tokenization. Designed for text mining and NLP workflows in Arabic-language contexts. -
8
RealtimeSTT
A robust, efficient, low-latency speech-to-text library
RealtimeSTT is a Python-based realtime speech-to-text engine emphasizing low latency, wake-word detection, voice activity detection, and automatic speech segmentation. It provides asynchronous callbacks, nanosecond-precision timestamps, and CLI tools, suitable for building voice assistants, meeting transcribers, or live caption systems. -
9
Fanyi
A 🇨🇳 and 🇺🇸 translate tool in your command line
Fanyi is a tool for translating words between the Chinese and English languages, right in your command line. It’s a good supportive tool for learning and reading the Chinese language from English, or the other way around. All translation data is fetched from iciba.com and fanyi.youdao.com, and with each translation comprehensive and related samples are given for better understanding and proper usage. There are translations for words as well as sentences, and in Mac/Linux bash, words can even... -
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
10
Pycorrector
Pycorrector is a toolkit for text error correction
Pycorrector is a Python toolkit for Chinese text error correction. It focuses on common error types such as similar-sounding characters, visually similar characters, grammar issues, proper noun errors, missing words, extra words, wrong words, and word-order problems. The project implements multiple correction approaches, including KenLM, ConvSeq2Seq, BERT, MacBERT, ELECTRA, ERNIE, GPT-style models, and newer Qwen-based correction models. -
11
spaCy
Industrial-strength Natural Language Processing (NLP)
spaCy is a library built on the very latest research for advanced Natural Language Processing (NLP) in Python and Cython. Since its inception it was designed to be used for real world applications-- for building real products and gathering real insights. It comes with pretrained statistical models and word vectors, convolutional neural network models, easy deep learning integration and so much more. spaCy is the fastest syntactic parser in the world according to independent benchmarks, with... -
12
Software Copyright Materials Skill
Skills, a Chinese software copyright application material generator
...It can generate application-form reference information, an operation manual, and source-code materials in Word and text formats. The project is designed to avoid invented code by extracting only from the user’s existing source files. It is especially useful for developers who want control over sensitive project details while still producing structured, submission-ready drafts. -
13
MediaCrawler
Self-media platform crawler
...Users can search by keyword, crawl specific posts, collect nested comments, and retrieve creator profiles. It also supports cached login states, proxy pools, and comment word-cloud generation. The repository is intended for learning and research, with clear restrictions against illegal, large-scale, or commercial scraping. -
14
koishi-plugin-novelai
Koishi plugin for NovelAI image generation with advanced controls
...It supports multiple configuration options, including model switching, sampler selection, and adjustable image sizes, giving users control over output quality and style. It includes advanced prompt syntax to refine results and allows automatic translation of Chinese keywords to improve usability across languages. A customizable banned word list helps filter unwanted content, while timed message recall can automatically delete generated outputs after a set period. Built on Koishi’s modular system, koishi-plugin-novelai can be extended with additional integrations, making it adaptable for different bot environments and use cases. -
15
patent-disclosure-skill
Point excavation and submission book
Patent Disclosure Skill is an Agent Skills package for creating and interpreting Chinese patent materials. In disclosure mode, it scans project documents, code, or a technical topic to identify candidate invention points. It can perform prior-art searching, organize technical comparisons, generate diagrams, and produce editable Markdown and Word disclosure documents. Existing disclosures can be revised through versioned updates with correction tracking. -
16
Collapse Launcher
An Advanced Launcher for miHoYo/HoYoverse Games
Collapse was originally designed for Honkai Impact 3rd. However, as the project evolved, this launcher is now a game client for all currently released miHoYo Games. Collapse came from the Honkai Impact translation in Chinese and Japanese. The word came from or Bēng huài in Chinese and also or Houkai in Japanese, both meaning "Collapse" which is why we chose it as our launcher name with the added inspiration that this was supposed to be an alternative (enhanced) launcher for Honkai Impact 3rd in the first place. -
17
spaCy models
Models for the spaCy Natural Language Processing (NLP) library
spaCy is designed to help you do real work, to build real products, or gather real insights. The library respects your time, and tries to avoid wasting it. It's easy to install, and its API is simple and productive. spaCy excels at large-scale information extraction tasks. It's written from the ground up in carefully memory-managed Cython. If your application needs to process entire web dumps, spaCy is the library you want to be using. Since its release in 2015, spaCy has become an industry... -
18
Saladict
Pop-up dictionary and page translator with multiple search modes
Chinese (simplified and traditional), Japanese, Korean are supported with dictionaries. Other languages are supported with several machine translation services. Each dictionary is well polished to a unify style for comfortable reading experience. Built-in Google, Lingocloud and Youdao Page Translation. -
19
The Ethers Project
Complete Ethereum library and wallet implementation in JavaScript
A complete Ethereum wallet implementation and utilities in JavaScript (and TypeScript). Keep your private keys in your client, safe and sound. Import and export JSON wallets (Geth, Parity and crowdsale) Import and export BIP 39 mnemonic phrases (12 word backup phrases) and HD Wallets (English as well as Czech, French, Italian, Japanese, Korean, Simplified Chinese, Spanish, Traditional Chinese. Meta-classes create JavaScript objects from any contract ABI, including ABIv2 and Human-Readable ABI. Connect to Ethereum nodes over JSON-RPC, INFURA, Etherscan, Alchemy, Ankr or MetaMask. ... -
20
BaikalDB
BaikalDB, A Distributed HTAP Database
...In a typical scenario, hundreds of millions of rows can be scanned and aggregated in few seconds. BaikalDB also supports full-text search by building inverted indices after word segmentation. Users can harness the fuzzy search features simply by adding a FULLTEXT KEY type index when creating tables. -
21
Qwen-Image
Qwen-Image is a powerful image generation foundation model
...Qwen-Image supports sophisticated editing tasks such as style transfer, object insertion and removal, detail enhancement, and even human pose manipulation, making it suitable for both professional and casual users. It also includes advanced image understanding capabilities like object detection, semantic segmentation, depth and edge estimation, and novel view synthesis. -
22
Tally
Your favorite dark mode word counter, now with grammar checking!
Tally - Word Counter is a free online tool to count the number of characters, words, paragraphs, and lines in your text. It can also show counts for different types of characters like letters, digits, spaces, punctuation, and symbols/special characters. Make sure you have the right number of words for your essay or post by counting them instantly with Tally. -
23
Qwen-2.5-VL
Qwen2.5-VL is the multimodal large language model series
Qwen2.5 is a series of large language models developed by the Qwen team at Alibaba Cloud, designed to enhance natural language understanding and generation across multiple languages. The models are available in various sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B parameters, catering to diverse computational requirements. Trained on a comprehensive dataset of up to 18 trillion tokens, Qwen2.5 models exhibit significant improvements in instruction following, long-text generation... -
24
PaddleNLP
Easy-to-use and powerful NLP library with Awesome model zoo
PaddleNLP It is a natural language processing development library for flying paddles, with Easy-to-use text area API, Examples of applications for multiple scenarios, and High-performance distributed training Three major features, aimed at improving the modeling efficiency of the flying oar developer's text field, aiming to improve the developer's development efficiency in the text field, and provide rich examples of NLP applications. Provide rich industry-level pre-task capabilities Taskflow And process-wide text area API: Support for the loading of rich Chinese data sets Dataset API, can flexibly and efficiently complete data pretreatment Data API, Preset 60 + pre-training word vector Embedding API, Providing 100 + pre-training model Transformer API Wait, the efficiency of NLP task modeling can be greatly improved. -
25
Flying-Bird-Wallpaper
Flying Bird Wallpaper is a feature-rich desktop wallpaper application
Flying Bird Wallpaper is a feature-rich desktop wallpaper application that supports multiple wallpaper types including images, videos, rhythm wallpapers, and solid colors, making your desktop unique and vibrant.
