Skip to content

ETL Release

AWS Batch (Impresoft Engage Hosting)

  • ETL flows must be installed on the dedicated Portal Cron machine:
    /media/connectx/<CLIENT_NAME>
  • Step 1: Submit a request to SYS. Example:
    Prepare the Portal Cron environment for the project <client_name> with the following configuration:

    Test Environment

    • Folder: /media/connectx/<client_name>/test
    • File to schedule: main.py
    • Environment: test
    • Core ConnectX: 4.x
    • Schedule: daily at 20:00

    Production Environment

    • Folder: /media/connectx/<client_name>/prod
    • File to schedule: main.py
    • Environment: prod
    • Core ConnectX: 4.x
    • Schedule: daily at 11:00 and 22:00
  • SYS team will create directories and configure scheduling on AWS Batch.

  • Once SYS tasks are completed, the DEV must clone the project on the Portal Cron server with correctly configured environments.
  • Release is considered complete only after DEV successfully runs the test_connections.py script, updated with all necessary integration connections.

Client Windows Machine

  • <TODO>

Client Linux Machine

  • <TODO>