Branch: refs/heads/add-copyright
Home: https://github.com/MarquezProject/marquez
Commit: ac7a4558343a52899263a4d83b05d0cffe51be92
https://github.com/MarquezProject/marquez/commit/ac7a4558343a52899263a4d83b05d0cffe51be92
Author: Ryan Hatter <25823361+RNHTTR@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M docker-compose.yml

Log Message:
-----------
Randomly map postgres db port (#2000)

Signed-off-by: Ryan Hatter <ryan.hatter@...>

Co-authored-by: Ryan Hatter <ryan.hatter@...>


Commit: 0021a2b7009ec84262af3c9a6403b9e80d017454
https://github.com/MarquezProject/marquez/commit/0021a2b7009ec84262af3c9a6403b9e80d017454
Author: Michael Collado <40346148+collado-mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/MarquezContext.java
M api/src/main/java/marquez/api/JobResource.java
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/JobVersionDao.java
M api/src/main/java/marquez/db/LineageDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/SearchDao.java
M api/src/main/java/marquez/graphql/GraphqlDaos.java
M api/src/main/java/marquez/service/LineageService.java
M api/src/main/java/marquez/service/RunService.java
A api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
A api/src/main/resources/marquez/db/migration/V44__runs_job_versions_add_job_uuid.sql
M api/src/test/java/marquez/MarquezAppIntegrationTest.java
M api/src/test/java/marquez/db/DbTestUtils.java
M api/src/test/java/marquez/db/JobVersionDaoTest.java
M api/src/test/java/marquez/db/RunDaoTest.java
M api/src/test/java/marquez/service/LineageServiceTest.java

Log Message:
-----------
Job parent hierarchy (#1935)

* Add migrations to support job parent relationship storage

Signed-off-by: Michael Collado <collado.mike@...>

* Update all job and run queries to reference jobs_view and runs_view

Signed-off-by: Michael Collado <collado.mike@...>

* Remove references to simple_name as job redirects handle redirecting simple name to fqn
added unit test to verify

Signed-off-by: Michael Collado <collado.mike@...>

* Fix runs migration script

Signed-off-by: Michael Collado <collado.mike@...>

* Rename sql migration script

Signed-off-by: Michael Collado <collado.mike@...>


Commit: 9d9770817664128d37ce2523ab97bb66374ec31a
https://github.com/MarquezProject/marquez/commit/9d9770817664128d37ce2523ab97bb66374ec31a
Author: Michael Collado <40346148+collado-mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/common/Utils.java
M api/src/main/java/marquez/db/FlywayFactory.java
A api/src/main/java/marquez/db/migrations/V43_1__UpdateRunsWithJobUUID.java
A api/src/main/java/marquez/db/migrations/V44_1__BackfillAirflowParentRuns.java
A api/src/main/java/marquez/db/migrations/V44_2_BackfillJobsWithParents.java
A api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/LineageTestUtils.java
A api/src/test/java/marquez/db/migrations/V44_1__BackfillAirflowParentRunsTest.java
A api/src/test/java/marquez/db/migrations/V44_2_BackfillJobsWithParentsTest.java
M api/src/test/java/marquez/jdbi/MarquezJdbiExternalPostgresExtension.java

Log Message:
-----------
Add java migrations for backfilling runs with job uuids and parents (#1980)

* Add migrations to support job parent relationship storage

Signed-off-by: Michael Collado <collado.mike@...>

* Update all job and run queries to reference jobs_view and runs_view

Signed-off-by: Michael Collado <collado.mike@...>

* Remove references to simple_name as job redirects handle redirecting simple name to fqn
added unit test to verify

Signed-off-by: Michael Collado <collado.mike@...>

* Fix runs migration script

Signed-off-by: Michael Collado <collado.mike@...>

* Add java migrations for backfilling runs with job uuids and backfill Airflow runs
Signed-off-by: Michael Collado <collado.mike@...>

Signed-off-by: Michael Collado <collado.mike@...>


Commit: dd5f53fe68e0faaf12125dbbe54de5692bbf4c07
https://github.com/MarquezProject/marquez/commit/dd5f53fe68e0faaf12125dbbe54de5692bbf4c07
Author: Michael Collado <40346148+collado-mike@...>
Date: 2022-05-20 (Fri, 20 May 2022)

Changed paths:
M api/src/main/java/marquez/db/Columns.java
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/mappers/ExtendedRunRowMapper.java
M api/src/main/java/marquez/db/mappers/JobDataMapper.java
M api/src/main/java/marquez/db/mappers/JobMapper.java
M api/src/main/java/marquez/db/mappers/JobRowMapper.java
M api/src/main/java/marquez/db/models/ExtendedRunRow.java
M api/src/main/java/marquez/db/models/JobData.java
M api/src/main/java/marquez/db/models/JobRow.java
M api/src/main/java/marquez/db/models/RunRow.java
M api/src/main/java/marquez/service/models/Job.java
M api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
M api/src/test/java/marquez/OpenLineageIntegrationTest.java
M api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/DbTestUtils.java
M api/src/test/java/marquez/db/RunDaoTest.java
M api/src/test/java/marquez/db/mappers/JobMapperTest.java
M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java
M api/src/test/resources/mappers/full_job_mapper.json
M clients/java/src/main/java/marquez/client/models/Job.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

Log Message:
-----------
Job parent hierarchy api changes (#1992)

* Update API to write parent jobs and parent runs for OpenLineage events

Signed-off-by: Michael Collado <collado.mike@...>

* Added integration tests to verify behavior when recording Airflow jobs with parents

Signed-off-by: Michael Collado <collado.mike@...>

* Added integration test for airflow -> spark task recording

Signed-off-by: Michael Collado <collado.mike@...>

* Added simpleName field to Job model and updated integration tests

Signed-off-by: Michael Collado <collado.mike@...>

* Added parent job name to job models

Signed-off-by: Michael Collado <collado.mike@...>


Commit: e5c1fea533b11fd42d25b8efe5125757d0cd2914
https://github.com/MarquezProject/marquez/commit/e5c1fea533b11fd42d25b8efe5125757d0cd2914
Author: Ryan Hatter <25823361+RNHTTR@...>
Date: 2022-05-23 (Mon, 23 May 2022)

Changed paths:
A web/src/img/favicon.png
A web/src/img/icon.svg
M web/src/index.html
M web/src/index.prod.html

Log Message:
-----------
Add favicon (#2001)

Signed-off-by: Ryan Hatter <ryan.hatter@...>

Co-authored-by: Ryan Hatter <ryan.hatter@...>
Co-authored-by: Peter Hicks <phixMe@...>


Commit: f10ad00ac2b4c327b792a43e188ef10cf7b5a211
https://github.com/MarquezProject/marquez/commit/f10ad00ac2b4c327b792a43e188ef10cf7b5a211
Author: Michael Robinson <68482867+merobi-hub@...>
Date: 2022-05-27 (Fri, 27 May 2022)

Changed paths:
M api/src/main/java/marquez/MarquezContext.java
M api/src/main/java/marquez/api/JobResource.java
M api/src/main/java/marquez/common/Utils.java
M api/src/main/java/marquez/db/Columns.java
M api/src/main/java/marquez/db/FlywayFactory.java
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/JobVersionDao.java
M api/src/main/java/marquez/db/LineageDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/SearchDao.java
M api/src/main/java/marquez/db/mappers/ExtendedRunRowMapper.java
M api/src/main/java/marquez/db/mappers/JobDataMapper.java
M api/src/main/java/marquez/db/mappers/JobMapper.java
M api/src/main/java/marquez/db/mappers/JobRowMapper.java
A api/src/main/java/marquez/db/migrations/V43_1__UpdateRunsWithJobUUID.java
A api/src/main/java/marquez/db/migrations/V44_1__BackfillAirflowParentRuns.java
A api/src/main/java/marquez/db/migrations/V44_2_BackfillJobsWithParents.java
M api/src/main/java/marquez/db/models/ExtendedRunRow.java
M api/src/main/java/marquez/db/models/JobData.java
M api/src/main/java/marquez/db/models/JobRow.java
M api/src/main/java/marquez/db/models/RunRow.java
M api/src/main/java/marquez/graphql/GraphqlDaos.java
M api/src/main/java/marquez/service/LineageService.java
M api/src/main/java/marquez/service/RunService.java
M api/src/main/java/marquez/service/models/Job.java
A api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
A api/src/main/resources/marquez/db/migration/V44__runs_job_versions_add_job_uuid.sql
M api/src/test/java/marquez/MarquezAppIntegrationTest.java
M api/src/test/java/marquez/OpenLineageIntegrationTest.java
A api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/DbTestUtils.java
M api/src/test/java/marquez/db/JobVersionDaoTest.java
M api/src/test/java/marquez/db/LineageTestUtils.java
M api/src/test/java/marquez/db/RunDaoTest.java
M api/src/test/java/marquez/db/mappers/JobMapperTest.java
A api/src/test/java/marquez/db/migrations/V44_1__BackfillAirflowParentRunsTest.java
A api/src/test/java/marquez/db/migrations/V44_2_BackfillJobsWithParentsTest.java
M api/src/test/java/marquez/jdbi/MarquezJdbiExternalPostgresExtension.java
M api/src/test/java/marquez/service/LineageServiceTest.java
M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java
M api/src/test/resources/mappers/full_job_mapper.json
M clients/java/src/main/java/marquez/client/models/Job.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java
M docker-compose.yml
A web/src/img/favicon.png
A web/src/img/icon.svg
M web/src/index.html
M web/src/index.prod.html

Log Message:
-----------
Merge branch 'main' into add-copyright


Compare: https://github.com/MarquezProject/marquez/compare/256b47b1174f...f10ad00ac2b4