Branch: refs/heads/fix_recursive_views_perf
Home: https://github.com/MarquezProject/marquez
Commit: 41834d550b3d88a6e02bbd9dd13d1a7243f43ced
https://github.com/MarquezProject/marquez/commit/41834d550b3d88a6e02bbd9dd13d1a7243f43ced
Author: Michael Collado <collado.mike@...>
Date: 2022-07-14 (Thu, 14 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
A api/src/main/resources/marquez/db/migration/V45__update_jobs_view_rule.sql
M api/src/test/java/marquez/MarquezAppIntegrationTest.java
M api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java

Log Message:
-----------
Update JobsDao to stop updating existing jobs unnecessarily

Signed-off-by: Michael Collado <collado.mike@...>


Commit: 7313f1d98c7f4e115e6ea202e524966f68b9c41c
https://github.com/MarquezProject/marquez/commit/7313f1d98c7f4e115e6ea202e524966f68b9c41c
Author: Michael Collado <collado.mike@...>
Date: 2022-07-14 (Thu, 14 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/JobVersionDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/migrations/V44_2__BackfillAirflowParentRuns.java
M api/src/main/java/marquez/db/migrations/V44_3_BackfillJobsWithParents.java
M api/src/main/java/marquez/service/RunService.java
M api/src/test/java/marquez/db/JobVersionDaoTest.java
M api/src/test/java/marquez/db/RunDaoTest.java

Log Message:
-----------
Remove need to query JobRow on run completion

Signed-off-by: Michael Collado <collado.mike@...>


Commit: 3e664d7b9d7dc8103b210e600965adc4be8c9b80
https://github.com/MarquezProject/marquez/commit/3e664d7b9d7dc8103b210e600965adc4be8c9b80
Author: Michael Collado <collado.mike@...>
Date: 2022-07-14 (Thu, 14 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/resources/marquez/db/migration/V45__update_jobs_view_rule.sql

Log Message:
-----------
Remove insert rule for job dao

Signed-off-by: Michael Collado <collado.mike@...>


Commit: 35366ff7302b4f188dfaccacebc12239040b0e96
https://github.com/MarquezProject/marquez/commit/35366ff7302b4f188dfaccacebc12239040b0e96
Author: Michael Collado <collado.mike@...>
Date: 2022-07-14 (Thu, 14 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/JobDao.java

Log Message:
-----------
Change jobdao to query before insert

Signed-off-by: Michael Collado <collado.mike@...>


Commit: 42d4c670f10dc1e9308d05d6d4e2d8b4155cd390
https://github.com/MarquezProject/marquez/commit/42d4c670f10dc1e9308d05d6d4e2d8b4155cd390
Author: Michael Collado <collado.mike@...>
Date: 2022-07-14 (Thu, 14 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/service/models/Run.java

Log Message:
-----------
Stop writing job context to runs

Signed-off-by: Michael Collado <collado.mike@...>


Commit: aa2e623ff83dd12fbecbfaac84482a957d941d09
https://github.com/MarquezProject/marquez/commit/aa2e623ff83dd12fbecbfaac84482a957d941d09
Author: Michael Collado <collado.mike@...>
Date: 2022-07-14 (Thu, 14 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/JobDao.java

Log Message:
-----------
Fix job dao conflict for parent id string

Signed-off-by: Michael Collado <collado.mike@...>


Commit: be602138a3d329fd23e38d17aa0d5b40ae281bf4
https://github.com/MarquezProject/marquez/commit/be602138a3d329fd23e38d17aa0d5b40ae281bf4
Author: Michael Collado <collado.mike@...>
Date: 2022-07-14 (Thu, 14 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/JobDao.java

Log Message:
-----------
Undid job query before insert

Signed-off-by: Michael Collado <collado.mike@...>


Commit: 5169781b6200b06a2939c693e6c145af38528670
https://github.com/MarquezProject/marquez/commit/5169781b6200b06a2939c693e6c145af38528670
Author: Michael Collado <collado.mike@...>
Date: 2022-07-14 (Thu, 14 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
A api/src/main/java/marquez/db/mappers/RunRowMapper.java
M api/src/main/java/marquez/db/models/ExtendedRunRow.java
M api/src/main/java/marquez/db/models/RunRow.java
M api/src/main/java/marquez/service/DatasetService.java
M api/src/main/java/marquez/service/JobService.java
M api/src/main/java/marquez/service/OpenLineageService.java
M api/src/main/java/marquez/service/RunService.java
M api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/DbTestUtils.java
M api/src/test/java/marquez/db/JobVersionDaoTest.java
M api/src/test/java/marquez/db/RunDaoTest.java
M api/src/test/java/marquez/db/migrations/V44_3_BackfillJobsWithParentsTest.java

Log Message:
-----------
Changed RunDao to use simple RunRow rather than ExtendedRunRow where possible

Signed-off-by: Michael Collado <collado.mike@...>


Commit: c5a7dc350d8b07df51b0f5c3b61c776f5175f70f
https://github.com/MarquezProject/marquez/commit/c5a7dc350d8b07df51b0f5c3b61c776f5175f70f
Author: Michael Collado <collado.mike@...>
Date: 2022-07-15 (Fri, 15 Jul 2022)

Changed paths:
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/resources/marquez/db/migration/V45__update_jobs_view_rule.sql
M api/src/test/java/marquez/MarquezAppIntegrationTest.java
M api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/JobDaoTest.java
M api/src/test/java/marquez/db/migrations/V44_3_BackfillJobsWithParentsTest.java
M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java

Log Message:
-----------
Refactor jobs_view to use job_fqn table

Signed-off-by: Michael Collado <collado.mike@...>


Compare: https://github.com/MarquezProject/marquez/compare/41834d550b3d%5E...c5a7dc350d8b