We have a number of SQL joins in the job. Each SQL joins has a target table for which indexes are should be created and we are using the BY clause for sorting. For all these target tables apart from one, the indexes are not getting created. We have looked into all the nodes(including sources tables, target tables and transformations for all the joins) but could not find anything conclusive. To elaborate upon the migration, we had first migrated the job with dependencies(not all but partially). There are a few template/temporary tables which create data sets with time stamps. We took all of them except the ones which we could physically migrate and create the metadata. During our first run, we found that we had missed creating the meatdata for these migrated datasets. We then, created the metadata and re-migrated the jobs. But we found that the same issue persists. We then analyzed the tables for thich we had created the metadata and found that the indexes were not present for these tables. We then, created the indexes manually, but after re-running the job, the index creation fails again. There are not errors though. Finally, we imported the metadata for all these tables from the old environment and tried to run the job again to find the same problem. Do you need more inputs here ? We have tried looking at the code but will have a look again to see if we have missed something.
... View more