[MarquezProject/marquez] 9d9770: Add java migrations for backfilling runs with job ...


GitHub
 

Branch: refs/heads/main
Home: https://github.com/MarquezProject/marquez
Commit: 9d9770817664128d37ce2523ab97bb66374ec31a
https://github.com/MarquezProject/marquez/commit/9d9770817664128d37ce2523ab97bb66374ec31a
Author: Michael Collado <40346148+collado-mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/common/Utils.java
M api/src/main/java/marquez/db/FlywayFactory.java
A api/src/main/java/marquez/db/migrations/V43_1__UpdateRunsWithJobUUID.java
A api/src/main/java/marquez/db/migrations/V44_1__BackfillAirflowParentRuns.java
A api/src/main/java/marquez/db/migrations/V44_2_BackfillJobsWithParents.java
A api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/LineageTestUtils.java
A api/src/test/java/marquez/db/migrations/V44_1__BackfillAirflowParentRunsTest.java
A api/src/test/java/marquez/db/migrations/V44_2_BackfillJobsWithParentsTest.java
M api/src/test/java/marquez/jdbi/MarquezJdbiExternalPostgresExtension.java

Log Message:
-----------
Add java migrations for backfilling runs with job uuids and parents (#1980)

* Add migrations to support job parent relationship storage

Signed-off-by: Michael Collado <collado.mike@...>

* Update all job and run queries to reference jobs_view and runs_view

Signed-off-by: Michael Collado <collado.mike@...>

* Remove references to simple_name as job redirects handle redirecting simple name to fqn
added unit test to verify

Signed-off-by: Michael Collado <collado.mike@...>

* Fix runs migration script

Signed-off-by: Michael Collado <collado.mike@...>

* Add java migrations for backfilling runs with job uuids and backfill Airflow runs
Signed-off-by: Michael Collado <collado.mike@...>

Signed-off-by: Michael Collado <collado.mike@...>