arc53--docsgpt
wehub-resource-sync
fed8b2eed7
Build and push multi-arch DocsGPT Docker image / build (linux/amd64, ubuntu-latest, amd64) (push) Has been cancelled
Backend release / release (push) Has been cancelled
Bandit Security Scan / bandit_scan (push) Has been cancelled
Build and push multi-arch DocsGPT Docker image / build (linux/arm64, ubuntu-24.04-arm, arm64) (push) Has been cancelled
Build and push multi-arch DocsGPT Docker image / manifest (push) Has been cancelled
Build and push DocsGPT FE Docker image for development / build (linux/amd64, ubuntu-latest, amd64) (push) Has been cancelled
Build and push DocsGPT FE Docker image for development / build (linux/arm64, ubuntu-24.04-arm, arm64) (push) Has been cancelled
Build and push DocsGPT FE Docker image for development / manifest (push) Has been cancelled
Python linting / ruff (push) Has been cancelled
Run python tests with pytest / Run tests and count coverage (3.12) (push) Has been cancelled
React Widget Build / build (push) Has been cancelled
29 行
1.2 KiB
Plaintext
29 行
1.2 KiB
Plaintext
Notes on multilingual text handling.
|
|
|
|
These notes illustrate a handful of typographic and script considerations
|
|
that software dealing with international text must keep in mind. The
|
|
examples intentionally mix several writing systems so that a parser can be
|
|
exercised end to end.
|
|
|
|
Latin script covers English, French, German, Spanish and many more. The
|
|
em-dash — together with the en-dash – is used for pauses and
|
|
ranges. Curly quotes such as “hello” and ‘world’ are
|
|
preferred in polished prose, while straight quotes remain common in
|
|
source code. An ellipsis character … compresses three dots into a
|
|
single glyph.
|
|
|
|
Cyrillic script is used for Russian, Ukrainian, Bulgarian and several
|
|
other languages. A short sample: Привет,
|
|
мир. Это простой
|
|
тестовый текст.
|
|
|
|
CJK ideographs cover written Chinese, Japanese and Korean. A short
|
|
sample of each: 你好世界. こんにちは世界.
|
|
안녕하세요 세계.
|
|
|
|
Punctuation worth noting includes the middle dot ·, the section sign
|
|
§, the pilcrow ¶ and the interrobang ‽. A well-behaved text
|
|
pipeline preserves each of these exactly, normalises line endings to a
|
|
single convention, and never silently replaces characters it does not
|
|
understand.
|