py-worker

py-worker An architecture diagram generated by Archify. worker.py · asyncio · signals · Architecture component worker.py asyncio · signals BullMQ consumers · workers/ · Architecture component BullMQ consumers workers/ Temporal worker · temporal/ · Architecture component Temporal worker temporal/ Redis · the API's queues · Architecture component Redis the API's queues PostgreSQL · SQLAlchemy · Architecture component PostgreSQL SQLAlchemy Temporal · task queue python · Architecture component Temporal task queue python Logs · stdout · files · Architecture component Logs stdout · files OpenObserve · OTLP · Architecture component OpenObserve OTLP jobs Legend Backend Database Message bus External

Same queues, other language

  • • Python bullmq speaks the same Redis protocol
  • • The API needn't know which worker runs a job
  • • Queue names must match the producer

Data

  • • Hand-written models mirror the API's schema
  • • Enums bind to the API's existing types
  • • The API owns every migration

Settings

  • • HOME_PATH is required and absolute
  • • DB_* and REDIS_* match the API
  • • Its own Temporal task queue: python