้กน็›ฎๆ–‡ไปถๅคน

ๆ–‡ไปถ
wehub-resource-sync e06fe8e8c6
Secret Leaks / trufflehog (push) Failing after 1s
Build documentation / build (push) Failing after 1s
Build documentation / build_other_lang (push) Failing after 0s
CodeQL Security Analysis / CodeQL Analysis (push) Failing after 0s
PR CI / pr-ci (push) Failing after 1s
Slow tests on important models (on Push - A10) / Get all modified files (push) Failing after 1s
Slow tests on important models (on Push - A10) / Model CI (push) Has been skipped
Self-hosted runner (benchmark) / Benchmark (aws-g5-4xlarge-cache) (push) Has been cancelled
New model PR merged notification / Notify new model (push) Has been cancelled
Update Transformers metadata / build_and_package (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 11:57:37 +08:00

5.3 KiB

๋กœ๊น… logging

๐Ÿค— ํŠธ๋žœ์Šคํฌ๋จธ๋Š” ์ค‘์•™ ์ง‘์ค‘์‹ ๋กœ๊น… ์‹œ์Šคํ…œ์„ ์ œ๊ณตํ•˜์—ฌ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์˜ ์ถœ๋ ฅ ๋ ˆ๋ฒจ์„ ์‰ฝ๊ฒŒ ์„ค์ •ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

ํ˜„์žฌ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์˜ ๊ธฐ๋ณธ ์ถœ๋ ฅ ๋ ˆ๋ฒจ์€ WARNING์œผ๋กœ ์„ค์ •๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.

์ถœ๋ ฅ ๋ ˆ๋ฒจ์„ ๋ณ€๊ฒฝํ•˜๋ ค๋ฉด ์ง์ ‘์ ์ธ ์„ค์ • ๋ฉ”์„œ๋“œ๋ฅผ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด, ์ถœ๋ ฅ ๋ ˆ๋ฒจ์„ INFO ์ˆ˜์ค€์œผ๋กœ ๋ณ€๊ฒฝํ•˜๋Š” ๋ฐฉ๋ฒ•์€ ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค.

import transformers

transformers.logging.set_verbosity_info()

ํ™˜๊ฒฝ ๋ณ€์ˆ˜ TRANSFORMERS_VERBOSITY๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๊ธฐ๋ณธ ์ถœ๋ ฅ ๋ ˆ๋ฒจ์„ ์žฌ์ •์˜ํ•  ์ˆ˜๋„ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋ฅผ debug, info, warning, error, critical, fatal ์ค‘ ํ•˜๋‚˜๋กœ ์„ค์ •ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค.

TRANSFORMERS_VERBOSITY=error ./myprogram.py

๋˜ํ•œ, ์ผ๋ถ€ warnings๋Š” ํ™˜๊ฒฝ ๋ณ€์ˆ˜ TRANSFORMERS_NO_ADVISORY_WARNINGS๋ฅผ 1๊ณผ ๊ฐ™์€ true ๊ฐ’์œผ๋กœ ์„ค์ •ํ•˜์—ฌ ๋น„ํ™œ์„ฑํ™”ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋ ‡๊ฒŒ ํ•˜๋ฉด [logger.warning_advice]๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๊ธฐ๋ก๋œ ๊ฒฝ๊ณ ๊ฐ€ ๋น„ํ™œ์„ฑํ™”๋ฉ๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค.

TRANSFORMERS_NO_ADVISORY_WARNINGS=1 ./myprogram.py

๋‹ค์Œ์€ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์™€ ๋™์ผํ•œ ๋กœ๊ฑฐ๋ฅผ ์ž์‹ ์˜ ๋ชจ๋“ˆ์ด๋‚˜ ์Šคํฌ๋ฆฝํŠธ์—์„œ ์‚ฌ์šฉํ•˜๋Š” ๋ฐฉ๋ฒ•์— ๋Œ€ํ•œ ์˜ˆ์‹œ์ž…๋‹ˆ๋‹ค.

from transformers.utils import logging

logging.set_verbosity_info()
logger = logging.get_logger("transformers")
logger.info("INFO")
logger.warning("WARN")

์ด ๋กœ๊น… ๋ชจ๋“ˆ์˜ ๋ชจ๋“  ๋ฉ”์„œ๋“œ๋Š” ์•„๋ž˜์— ๋ฌธ์„œํ™”๋˜์–ด ์žˆ์œผ๋ฉฐ, ์ฃผ์š” ๋ฉ”์„œ๋“œ๋Š” ํ˜„์žฌ ๋กœ๊ฑฐ์˜ ์ถœ๋ ฅ ์ˆ˜์ค€์„ ๊ฐ€์ ธ์˜ค๋Š” [logging.get_verbosity]์™€ ์›ํ•˜๋Š” ์ถœ๋ ฅ ์ˆ˜์ค€์œผ๋กœ ์„ค์ •ํ•˜๋Š” [logging.set_verbosity] ์ž…๋‹ˆ๋‹ค. ์ถœ๋ ฅ ์ˆ˜์ค€์€ (๊ฐ€์žฅ ์ ์€ ์ถœ๋ ฅ์—์„œ ๊ฐ€์žฅ ๋งŽ์€ ์ถœ๋ ฅ ์ˆœ์œผ๋กœ) ๋‹ค์Œ๊ณผ ๊ฐ™์œผ๋ฉฐ, ํ•ด๋‹น ์ˆ˜์ค€์— ๋Œ€์‘ํ•˜๋Š” ์ •์ˆ˜ ๊ฐ’์€ ๊ด„ํ˜ธ ์•ˆ์— ํ‘œ์‹œ๋ฉ๋‹ˆ๋‹ค.

  • transformers.logging.CRITICAL ๋˜๋Š” transformers.logging.FATAL (์ •์ˆซ๊ฐ’, 50): ๊ฐ€์žฅ ์‹ฌ๊ฐํ•œ ์˜ค๋ฅ˜๋งŒ ๋ณด๊ณ ํ•ฉ๋‹ˆ๋‹ค.
  • transformers.logging.ERROR (์ •์ˆซ๊ฐ’, 40): ์˜ค๋ฅ˜๋งŒ ๋ณด๊ณ ํ•ฉ๋‹ˆ๋‹ค.
  • transformers.logging.WARNING ๋˜๋Š” transformers.logging.WARN (์ •์ˆซ๊ฐ’, 30): ์˜ค๋ฅ˜์™€ ๊ฒฝ๊ณ ๋งŒ ๋ณด๊ณ ํ•ฉ๋‹ˆ๋‹ค. ์ด๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์—์„œ ๊ธฐ๋ณธ์œผ๋กœ ์‚ฌ์šฉ๋˜๋Š” ์ˆ˜์ค€์ž…๋‹ˆ๋‹ค.
  • transformers.logging.INFO (์ •์ˆซ๊ฐ’, 20): ์˜ค๋ฅ˜, ๊ฒฝ๊ณ , ๊ทธ๋ฆฌ๊ณ  ๊ธฐ๋ณธ์ ์ธ ์ •๋ณด๋ฅผ ๋ณด๊ณ ํ•ฉ๋‹ˆ๋‹ค.
  • transformers.logging.DEBUG (์ •์ˆซ๊ฐ’, 10): ๋ชจ๋“  ์ •๋ณด๋ฅผ ๋ณด๊ณ ํ•ฉ๋‹ˆ๋‹ค.

๊ธฐ๋ณธ์ ์œผ๋กœ ๋ชจ๋ธ ๋‹ค์šด๋กœ๋“œ ์ค‘์—๋Š” tqdm ์ง„ํ–‰ ํ‘œ์‹œ์ค„์ด ํ‘œ์‹œ๋ฉ๋‹ˆ๋‹ค. [logging.disable_progress_bar]์™€ [logging.enable_progress_bar]๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์ด ๋™์ž‘์„ ์ˆจ๊ธฐ๊ฑฐ๋‚˜ ๋‹ค์‹œ ํ‘œ์‹œํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

logging vs warningstransformers.utils.logging.captureWarnings

Python์—๋Š” ์ข…์ข… ํ•จ๊ป˜ ์‚ฌ์šฉ๋˜๋Š” ๋‘ ๊ฐ€์ง€ ๋กœ๊น… ์‹œ์Šคํ…œ์ด ์žˆ์Šต๋‹ˆ๋‹ค. ์œ„์—์„œ ์„ค๋ช…ํ•œ logging๊ณผ warnings์ž…๋‹ˆ๋‹ค. warnings๋Š” ํŠน์ • ๋ฒ”์ฃผ๋กœ ๊ฒฝ๊ณ ๋ฅผ ์„ธ๋ถ„ํ™”ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด, ์ด๋ฏธ ๋” ์ด์ƒ ์‚ฌ์šฉ๋˜์ง€ ์•Š๋Š” ๊ธฐ๋Šฅ์ด๋‚˜ ๊ฒฝ๋กœ์— ๋Œ€ํ•ด FutureWarning์ด ์‚ฌ์šฉ๋˜๊ณ , ๊ณง ์‚ฌ์šฉ ์ค‘๋‹จ๋  ๊ธฐ๋Šฅ์„ ์•Œ๋ฆฌ๊ธฐ ์œ„ํ•ด DeprecationWarning์ด ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค.

ํŠธ๋žœ์Šคํฌ๋จธ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์—์„œ๋Š” ๋‘ ์‹œ์Šคํ…œ ๋ชจ๋‘๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. logging์˜ captureWarnings ๋ฉ”์„œ๋“œ๋ฅผ ํ™œ์šฉํ•˜๊ณ  ์ด๋ฅผ ์กฐ์ •ํ•˜์—ฌ ์œ„์—์„œ ์„ค๋ช…ํ•œ ์ถœ๋ ฅ ์ˆ˜์ค€ ์„ค์ •์ž๋“ค์„ ํ†ตํ•ด ์ด๋Ÿฌํ•œ ๊ฒฝ๊ณ  ๋ฉ”์‹œ์ง€๋“ค์„ ๊ด€๋ฆฌํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•ฉ๋‹ˆ๋‹ค.

๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ๊ฐœ๋ฐœ์ž๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์€ ์ง€์นจ์„ ๋”ฐ๋ฅด๋Š” ๊ฒƒ์ด ์ข‹์Šต๋‹ˆ๋‹ค.

  • warnings๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ๊ฐœ๋ฐœ์ž์™€ transformers์— ์˜์กดํ•˜๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ๊ฐœ๋ฐœ์ž๋“ค์—๊ฒŒ ์œ ๋ฆฌํ•ฉ๋‹ˆ๋‹ค.
  • logging์€ ์ผ๋ฐ˜์ ์ธ ํ”„๋กœ์ ํŠธ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ๊ฐœ๋ฐœ์ž๋ณด๋‹ค๋Š”, ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ์ตœ์ข… ์‚ฌ์šฉ์ž๋“ค์—๊ฒŒ ์œ ๋ฆฌํ•  ๊ฒƒ์ž…๋‹ˆ๋‹ค.

์•„๋ž˜์—์„œ captureWarnings ๋ฉ”์†Œ๋“œ์— ๋Œ€ํ•œ ์ฐธ๊ณ  ์‚ฌํ•ญ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

autodoc logging.captureWarnings

๊ธฐ๋ณธ ์„ค์ •์ž transformers.utils.logging.set_verbosity_error

autodoc logging.set_verbosity_error

autodoc logging.set_verbosity_warning

autodoc logging.set_verbosity_info

autodoc logging.set_verbosity_debug

๊ธฐํƒ€ ํ•จ์ˆ˜ transformers.utils.logging.get_verbosity

autodoc logging.get_verbosity

autodoc logging.set_verbosity

autodoc logging.get_logger

autodoc logging.enable_default_handler

autodoc logging.disable_default_handler

autodoc logging.enable_explicit_format

autodoc logging.reset_format

autodoc logging.enable_progress_bar

autodoc logging.disable_progress_bar