Branch: refs/heads/job_parent_hierarchy_api_changes
Home: https://github.com/MarquezProject/marquez
Commit: 716005c4ce3e1fdb00c632a0cd57fb5aa4c492be
https://github.com/MarquezProject/marquez/commit/716005c4ce3e1fdb00c632a0cd57fb5aa4c492be
Author: Michael Collado <collado.mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/db/Columns.java
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/mappers/ExtendedRunRowMapper.java
M api/src/main/java/marquez/db/mappers/JobRowMapper.java
M api/src/main/java/marquez/db/models/ExtendedRunRow.java
M api/src/main/java/marquez/db/models/JobRow.java
M api/src/main/java/marquez/db/models/RunRow.java
M api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
M api/src/test/java/marquez/OpenLineageIntegrationTest.java
M api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/DbTestUtils.java
M api/src/test/java/marquez/db/RunDaoTest.java
M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java

Log Message:
-----------
Update API to write parent jobs and parent runs for OpenLineage events

Signed-off-by: Michael Collado <collado.mike@...>


Commit: 01f966dfdd4369774bd718ef8e9325b5eb568a8d
https://github.com/MarquezProject/marquez/commit/01f966dfdd4369774bd718ef8e9325b5eb568a8d
Author: Michael Collado <collado.mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/test/java/marquez/OpenLineageIntegrationTest.java

Log Message:
-----------
Added integration tests to verify behavior when recording Airflow jobs with parents

Signed-off-by: Michael Collado <collado.mike@...>


Commit: cee1d6686228e3740815fda4f0897d0a294e2f7b
https://github.com/MarquezProject/marquez/commit/cee1d6686228e3740815fda4f0897d0a294e2f7b
Author: Michael Collado <collado.mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/test/java/marquez/OpenLineageIntegrationTest.java

Log Message:
-----------
Added integration test for airflow -> spark task recording

Signed-off-by: Michael Collado <collado.mike@...>


Commit: 962d9cc603d62d54a23206e3bc4bf9bd5677bad1
https://github.com/MarquezProject/marquez/commit/962d9cc603d62d54a23206e3bc4bf9bd5677bad1
Author: Michael Collado <collado.mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/db/mappers/JobDataMapper.java
M api/src/main/java/marquez/db/mappers/JobMapper.java
M api/src/main/java/marquez/db/models/JobData.java
M api/src/main/java/marquez/service/models/Job.java
M api/src/test/java/marquez/OpenLineageIntegrationTest.java
M api/src/test/java/marquez/db/mappers/JobMapperTest.java
M api/src/test/resources/mappers/full_job_mapper.json
M clients/java/src/main/java/marquez/client/models/Job.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

Log Message:
-----------
Added simpleName field to Job model and updated integration tests

Signed-off-by: Michael Collado <collado.mike@...>


Commit: b64b7f9eed50b892f32fad0829a5a856d19876a6
https://github.com/MarquezProject/marquez/commit/b64b7f9eed50b892f32fad0829a5a856d19876a6
Author: Michael Collado <collado.mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/db/Columns.java
M api/src/main/java/marquez/db/mappers/JobDataMapper.java
M api/src/main/java/marquez/db/mappers/JobMapper.java
M api/src/main/java/marquez/db/mappers/JobRowMapper.java
M api/src/main/java/marquez/db/models/JobData.java
M api/src/main/java/marquez/db/models/JobRow.java
M api/src/main/java/marquez/service/models/Job.java
M api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
M api/src/test/java/marquez/OpenLineageIntegrationTest.java
M clients/java/src/main/java/marquez/client/models/Job.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

Log Message:
-----------
Added parent job name to job models

Signed-off-by: Michael Collado <collado.mike@...>


Compare: https://github.com/MarquezProject/marquez/compare/b3880887ec19...b64b7f9eed50