Skip to content

Developer Testing Checklist

Minimum tests that every developer should perform on any new project or modification in ConnectX.

Pre-Release Checks (Test or Development Environment)

Flow Verification

  • Verify the number of records processed.
    • Ensure that the number of loaded records matches the number of records in the source database.
  • Check for duplicates.
    • Run the flow again with the same source data to ensure no duplicate records are created.
  • Data quality check (sample at least 3 records):
    • Verify correctness of relationships according to mapping.
    • Check consistency of formats (dates, numbers, dropdowns, etc.).
    • Ensure all mapped fields are complete and correct, comparing source vs destination values.
    • Record the IDs or names of the records verified during testing for traceability.

Logging and Error Handling

  • Ensure that any errors or warnings are correctly logged (e.g., etl_job, etl_log).

Performance

  • Evaluate execution times and compare them with similar flows.
  • Identify potential bottlenecks (slow queries, inefficient transformations, etc.).

Migration from Another ETL

  • Perform a comparative run between old and new ETL versions.

Final Commit

  • Check that no test-only filters remain in the code (e.g., record filters, commented-out lines for testing).

Production Release Verification

Configuration

  • Ensure all production passwords are encrypted in config.py.
  • Verify that production configuration is set correctly.

Connection Tests

  • Run test_connection.py to verify all production connections (API, databases, etc.).
  • Email sending test.
  • SFTP connection test (if applicable).

Post-Release Checks

First Scheduled Run

  • Set a calendar reminder to verify that the flow executes correctly on its first scheduled run.

Data Verification

  • Ensure that data has been correctly loaded into the intended destination (e.g., check etl_job / etl_log modules).