Our preprocessing pipeline is a bit messy - and since we started implementing KG preprocessing in there, we should make sure it's up to a certain standard and follows defined data processes we have (eg where should preprocessing data be stored, should the final product be saved in GCS directly or locally)
Our preprocessing pipeline is a bit messy - and since we started implementing KG preprocessing in there, we should make sure it's up to a certain standard and follows defined data processes we have (eg where should preprocessing data be stored, should the final product be saved in GCS directly or locally)