Repository navigation

feat(cdk): add source-side memory monitoring (logging-only trial) - #941

Merged

Patrick Nilan (pnilan) merged 16 commits into

mainfrom

devin/1773091366-add-memory-monitor

Mar 10, 2026

Merged

feat(cdk): add source-side memory monitoring (logging-only trial)#941
Patrick Nilan (pnilan) merged 16 commits into
mainfrom
devin/1773091366-add-memory-monitor

Commits on Mar 9, 2026
- feat(cdk): add source-side memory introspection to emit controlled error messages before OOM kills
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  caa0c82
- style: fix ruff format and import sorting
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  8d059cf
- fix(cdk): add error handling to _read_memory() for graceful degradation
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  b2e233f
- fix(cdk): wrap read() loop in try/finally to flush queued messages on shutdown
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  ee93565
- refactor(cdk): encapsulate check interval inside MemoryMonitor
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  cca6c50
- refactor(cdk): move MemoryMonitor to AirbyteEntrypoint.__init__
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  ec56943
- test(cdk): add comprehensive memory monitor tests and graceful shutdown integration test
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  7f7ab40
- fix(cdk): change MemoryLimitExceeded to system_error and update user-facing message
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  a021eb7
- refactor(cdk): make DEFAULT_CHECK_INTERVAL private and drop circular tests
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  fc71aba
- refactor(cdk): move memory check before yield, test observable behavior via caplog
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  5f7e16d
- refactor(cdk): move memory check back to after yield for zero data loss
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  0485fa2
- style: fix ruff format in test_entrypoint.py
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  1621a39
Commits on Mar 10, 2026
- refactor(cdk): display memory usage in GB instead of raw bytes
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  4dda57c
- refactor(cdk): remove MemoryLimitExceeded subclass, raise AirbyteTracedException directly
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  c96825f
- fix(cdk): validate check_interval >= 1 to prevent ZeroDivisionError
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  cdc518c
- refactor(cdk): switch memory monitor to logging-only trial mode
  
  devin-ai-integration[bot]
  and
  bot_apk
  committed
  bf9db5f

Navigation Menu

Repository navigation

feat(cdk): add source-side memory monitoring (logging-only trial) - #941

feat(cdk): add source-side memory monitoring (logging-only trial)#941
Patrick Nilan (pnilan) merged 16 commits into
mainfrom
devin/1773091366-add-memory-monitor

Commits on Mar 9, 2026

feat(cdk): add source-side memory introspection to emit controlled error messages before OOM kills

style: fix ruff format and import sorting

fix(cdk): add error handling to _read_memory() for graceful degradation

fix(cdk): wrap read() loop in try/finally to flush queued messages on shutdown

refactor(cdk): encapsulate check interval inside MemoryMonitor

refactor(cdk): move MemoryMonitor to AirbyteEntrypoint.init

test(cdk): add comprehensive memory monitor tests and graceful shutdown integration test

fix(cdk): change MemoryLimitExceeded to system_error and update user-facing message

refactor(cdk): make DEFAULT_CHECK_INTERVAL private and drop circular tests

refactor(cdk): move memory check before yield, test observable behavior via caplog

refactor(cdk): move memory check back to after yield for zero data loss

style: fix ruff format in test_entrypoint.py

Commits on Mar 10, 2026

refactor(cdk): display memory usage in GB instead of raw bytes

refactor(cdk): remove MemoryLimitExceeded subclass, raise AirbyteTracedException directly

fix(cdk): validate check_interval >= 1 to prevent ZeroDivisionError

refactor(cdk): switch memory monitor to logging-only trial mode