Payments (Littlepay): make participant_id in union tables not explicit

[charlie-costanzo]

Description

This PR simplifies the process of unioning our intermediate Littlepay v1 + v3 tables by making the date filtering of participant_id not explicit

Resolves # (CREATE ISSUE AND ADD)

Type of change

• New feature

How has this been tested?

Include commands/logs/screenshots as relevant.

If making changes to dbt models, please run the command poetry run dbt run -s CHANGED_MODEL and poetry run dbt test -s CHANGED_MODEL, then include the output in this section of the PR.

Post-merge follow-ups

• No action required

[github-actions]

Terraform plan in iac/cal-itp-data-infra-staging/airflow/us

Plan: 0 to add, 10 to change, 0 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
!~  update in-place

Terraform will perform the following actions:

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_authorisations.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "z20Q6Q==" -> (known after apply)
!~      detect_md5hash      = "YK0ydM44EEN/HHm0O7OXSQ==" -> "different hash"
!~      generation          = 1749663113336692 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_authorisations.sql"
!~      md5hash             = "YK0ydM44EEN/HHm0O7OXSQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_authorisations.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_customer_funding_source.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "o4qf0g==" -> (known after apply)
!~      detect_md5hash      = "5ypkvGdW3s3amLxRcQKEAQ==" -> "different hash"
!~      generation          = 1749663117291093 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_customer_funding_source.sql"
!~      md5hash             = "5ypkvGdW3s3amLxRcQKEAQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_customer_funding_source.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transaction_purchases.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "YCfHaQ==" -> (known after apply)
!~      detect_md5hash      = "HQgGp4b5gYVy5fBFol6ktQ==" -> "different hash"
!~      generation          = 1749663117940260 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transaction_purchases.sql"
!~      md5hash             = "HQgGp4b5gYVy5fBFol6ktQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transaction_purchases.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transactions.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "KEXlTw==" -> (known after apply)
!~      detect_md5hash      = "f1woLuCQo4YI+CAwGMQA3w==" -> "different hash"
!~      generation          = 1749663117434405 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transactions.sql"
!~      md5hash             = "f1woLuCQo4YI+CAwGMQA3w==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transactions.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_adjustments.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "RKKX1g==" -> (known after apply)
!~      detect_md5hash      = "g6LmbBEaHUuU2cLiU9liAQ==" -> "different hash"
!~      generation          = 1749663119674926 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_adjustments.sql"
!~      md5hash             = "g6LmbBEaHUuU2cLiU9liAQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_adjustments.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_device_transactions.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "g3cvjA==" -> (known after apply)
!~      detect_md5hash      = "cvYUkW2gSR8D2oFYqxvS0g==" -> "different hash"
!~      generation          = 1749663112368111 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_device_transactions.sql"
!~      md5hash             = "cvYUkW2gSR8D2oFYqxvS0g==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_device_transactions.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayments.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "WsoINg==" -> (known after apply)
!~      detect_md5hash      = "XB7c3YyWqLy1sU7Fg3lXng==" -> "different hash"
!~      generation          = 1749663113506258 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayments.sql"
!~      md5hash             = "XB7c3YyWqLy1sU7Fg3lXng==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayments.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_product_data.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "JhwtwQ==" -> (known after apply)
!~      detect_md5hash      = "NcI4ZxW+DvmCtaVo7lAC7w==" -> "different hash"
!~      generation          = 1749663117273754 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_product_data.sql"
!~      md5hash             = "NcI4ZxW+DvmCtaVo7lAC7w==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_product_data.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_refunds.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "XRyhew==" -> (known after apply)
!~      detect_md5hash      = "Ee4FBE4a5CRzJYSLHBDNvA==" -> "different hash"
!~      generation          = 1749663112470980 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_refunds.sql"
!~      md5hash             = "Ee4FBE4a5CRzJYSLHBDNvA==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_refunds.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-staging-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_settlements.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-staging-composer-dags" {
!~      crc32c              = "qLXH7g==" -> (known after apply)
!~      detect_md5hash      = "MOYTdUgKHXeBT2Eiwh8HOQ==" -> "different hash"
!~      generation          = 1749663115707302 -> (known after apply)
        id                  = "calitp-staging-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_settlements.sql"
!~      md5hash             = "MOYTdUgKHXeBT2Eiwh8HOQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_settlements.sql"
#        (17 unchanged attributes hidden)
    }

Plan: 0 to add, 10 to change, 0 to destroy.

📝 Plan generated in Plan Terraform for Warehouse and DAG changes #776

[github-actions]

Terraform plan in iac/cal-itp-data-infra/airflow/us

Plan: 0 to add, 10 to change, 0 to destroy.

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
!~  update in-place

Terraform will perform the following actions:

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_authorisations.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "z20Q6Q==" -> (known after apply)
!~      detect_md5hash      = "YK0ydM44EEN/HHm0O7OXSQ==" -> "different hash"
!~      generation          = 1751416668558684 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_authorisations.sql"
!~      md5hash             = "YK0ydM44EEN/HHm0O7OXSQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_authorisations.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_customer_funding_source.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "o4qf0g==" -> (known after apply)
!~      detect_md5hash      = "5ypkvGdW3s3amLxRcQKEAQ==" -> "different hash"
!~      generation          = 1751416661967100 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_customer_funding_source.sql"
!~      md5hash             = "5ypkvGdW3s3amLxRcQKEAQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_customer_funding_source.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transaction_purchases.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "YCfHaQ==" -> (known after apply)
!~      detect_md5hash      = "HQgGp4b5gYVy5fBFol6ktQ==" -> "different hash"
!~      generation          = 1751416663427175 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transaction_purchases.sql"
!~      md5hash             = "HQgGp4b5gYVy5fBFol6ktQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transaction_purchases.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transactions.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "KEXlTw==" -> (known after apply)
!~      detect_md5hash      = "f1woLuCQo4YI+CAwGMQA3w==" -> "different hash"
!~      generation          = 1751416664367318 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transactions.sql"
!~      md5hash             = "f1woLuCQo4YI+CAwGMQA3w==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_device_transactions.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_adjustments.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "RKKX1g==" -> (known after apply)
!~      detect_md5hash      = "g6LmbBEaHUuU2cLiU9liAQ==" -> "different hash"
!~      generation          = 1751416663376696 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_adjustments.sql"
!~      md5hash             = "g6LmbBEaHUuU2cLiU9liAQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_adjustments.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_device_transactions.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "g3cvjA==" -> (known after apply)
!~      detect_md5hash      = "cvYUkW2gSR8D2oFYqxvS0g==" -> "different hash"
!~      generation          = 1751416661128559 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_device_transactions.sql"
!~      md5hash             = "cvYUkW2gSR8D2oFYqxvS0g==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayment_device_transactions.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayments.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "WsoINg==" -> (known after apply)
!~      detect_md5hash      = "XB7c3YyWqLy1sU7Fg3lXng==" -> "different hash"
!~      generation          = 1751416668450488 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayments.sql"
!~      md5hash             = "XB7c3YyWqLy1sU7Fg3lXng==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_micropayments.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_product_data.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "JhwtwQ==" -> (known after apply)
!~      detect_md5hash      = "NcI4ZxW+DvmCtaVo7lAC7w==" -> "different hash"
!~      generation          = 1751416665943823 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_product_data.sql"
!~      md5hash             = "NcI4ZxW+DvmCtaVo7lAC7w==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_product_data.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_refunds.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "XRyhew==" -> (known after apply)
!~      detect_md5hash      = "Ee4FBE4a5CRzJYSLHBDNvA==" -> "different hash"
!~      generation          = 1751416661145863 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_refunds.sql"
!~      md5hash             = "Ee4FBE4a5CRzJYSLHBDNvA==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_refunds.sql"
#        (17 unchanged attributes hidden)
    }

  # google_storage_bucket_object.calitp-composer-dags["models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_settlements.sql"] will be updated in-place
!~  resource "google_storage_bucket_object" "calitp-composer-dags" {
!~      crc32c              = "qLXH7g==" -> (known after apply)
!~      detect_md5hash      = "MOYTdUgKHXeBT2Eiwh8HOQ==" -> "different hash"
!~      generation          = 1751416663021794 -> (known after apply)
        id                  = "calitp-composer-data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_settlements.sql"
!~      md5hash             = "MOYTdUgKHXeBT2Eiwh8HOQ==" -> (known after apply)
        name                = "data/warehouse/models/intermediate/payments/littlepay_feed_unions/int_littlepay__unioned_settlements.sql"
#        (17 unchanged attributes hidden)
    }

Plan: 0 to add, 10 to change, 0 to destroy.

📝 Plan generated in Plan Terraform for Warehouse and DAG changes #776