[MarquezProject/marquez] 0021a2: Job parent hierarchy (#1935)


GitHub
 

Branch: refs/heads/main
Home: https://github.com/MarquezProject/marquez
Commit: 0021a2b7009ec84262af3c9a6403b9e80d017454
https://github.com/MarquezProject/marquez/commit/0021a2b7009ec84262af3c9a6403b9e80d017454
Author: Michael Collado <40346148+collado-mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/MarquezContext.java
M api/src/main/java/marquez/api/JobResource.java
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/JobVersionDao.java
M api/src/main/java/marquez/db/LineageDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/SearchDao.java
M api/src/main/java/marquez/graphql/GraphqlDaos.java
M api/src/main/java/marquez/service/LineageService.java
M api/src/main/java/marquez/service/RunService.java
A api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
A api/src/main/resources/marquez/db/migration/V44__runs_job_versions_add_job_uuid.sql
M api/src/test/java/marquez/MarquezAppIntegrationTest.java
M api/src/test/java/marquez/db/DbTestUtils.java
M api/src/test/java/marquez/db/JobVersionDaoTest.java
M api/src/test/java/marquez/db/RunDaoTest.java
M api/src/test/java/marquez/service/LineageServiceTest.java

Log Message:
-----------
Job parent hierarchy (#1935)

* Add migrations to support job parent relationship storage

Signed-off-by: Michael Collado <collado.mike@...>

* Update all job and run queries to reference jobs_view and runs_view

Signed-off-by: Michael Collado <collado.mike@...>

* Remove references to simple_name as job redirects handle redirecting simple name to fqn
added unit test to verify

Signed-off-by: Michael Collado <collado.mike@...>

* Fix runs migration script

Signed-off-by: Michael Collado <collado.mike@...>

* Rename sql migration script

Signed-off-by: Michael Collado <collado.mike@...>

Join marquez-technical-discuss@lists.lfaidata.foundation to automatically receive all group messages.