Branch: refs/heads/main
Home: https://github.com/MarquezProject/marquez
Commit: dd5f53fe68e0faaf12125dbbe54de5692bbf4c07
https://github.com/MarquezProject/marquez/commit/dd5f53fe68e0faaf12125dbbe54de5692bbf4c07
Author: Michael Collado <40346148+collado-mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/db/Columns.java
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/mappers/ExtendedRunRowMapper.java
M api/src/main/java/marquez/db/mappers/JobDataMapper.java
M api/src/main/java/marquez/db/mappers/JobMapper.java
M api/src/main/java/marquez/db/mappers/JobRowMapper.java
M api/src/main/java/marquez/db/models/ExtendedRunRow.java
M api/src/main/java/marquez/db/models/JobData.java
M api/src/main/java/marquez/db/models/JobRow.java
M api/src/main/java/marquez/db/models/RunRow.java
M api/src/main/java/marquez/service/models/Job.java
M api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
M api/src/test/java/marquez/OpenLineageIntegrationTest.java
M api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/DbTestUtils.java
M api/src/test/java/marquez/db/RunDaoTest.java
M api/src/test/java/marquez/db/mappers/JobMapperTest.java
M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java
M api/src/test/resources/mappers/full_job_mapper.json
M clients/java/src/main/java/marquez/client/models/Job.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

Log Message:
-----------
Job parent hierarchy api changes (#1992)

* Update API to write parent jobs and parent runs for OpenLineage events

Signed-off-by: Michael Collado <collado.mike@...>

* Added integration tests to verify behavior when recording Airflow jobs with parents

Signed-off-by: Michael Collado <collado.mike@...>

* Added integration test for airflow -> spark task recording

Signed-off-by: Michael Collado <collado.mike@...>

* Added simpleName field to Job model and updated integration tests

Signed-off-by: Michael Collado <collado.mike@...>

* Added parent job name to job models

Signed-off-by: Michael Collado <collado.mike@...>