marquez-technical-discuss@lists.lfaidata.foundation

[MarquezProject/marquez] 0283d4: chore(deps): update jdbi3version to v3.29.0

GitHub

#190

Branch: refs/heads/renovate/jdbi3version
  Home:   https://github.com/MarquezProject/marquez
  Commit: 0283d4d843a7ffe45a46460473369698ba49e626
      https://github.com/MarquezProject/marquez/commit/0283d4d843a7ffe45a46460473369698ba49e626
  Author: Renovate Bot <bot@...>
  Date:   2022-05-21 (Sat, 21 May 2022)

  Changed paths:
    M api/build.gradle

  Log Message:
  -----------
  chore(deps): update jdbi3version to v3.29.0

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] abe363: chore(deps): update testcontainersversion to v1.17.2

GitHub

#189

Branch: refs/heads/renovate/patch-testcontainersversion
  Home:   https://github.com/MarquezProject/marquez
  Commit: abe36385276dc29238df08b7ae2e4c2bd3506dcc
      https://github.com/MarquezProject/marquez/commit/abe36385276dc29238df08b7ae2e4c2bd3506dcc
  Author: Renovate Bot <bot@...>
  Date:   2022-05-21 (Sat, 21 May 2022)

  Changed paths:
    M api/build.gradle

  Log Message:
  -----------
  chore(deps): update testcontainersversion to v1.17.2

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] 49c363: chore(deps): update dependency org.flywaydb:flyway...

GitHub

#188

Branch: refs/heads/renovate/org.flywaydb-flyway-core-8.5.x
  Home:   https://github.com/MarquezProject/marquez
  Commit: 49c363e6303803cf47a77bfbb98f0750a1ee0f9e
      https://github.com/MarquezProject/marquez/commit/49c363e6303803cf47a77bfbb98f0750a1ee0f9e
  Author: Renovate Bot <bot@...>
  Date:   2022-05-21 (Sat, 21 May 2022)

  Changed paths:
    M api/build.gradle

  Log Message:
  -----------
  chore(deps): update dependency org.flywaydb:flyway-core to v8.5.11

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] 5d0487: chore(deps): update dependency io.openlineage:open...

GitHub

#187

Branch: refs/heads/renovate/patch-openlineageversion
  Home:   https://github.com/MarquezProject/marquez
  Commit: 5d048720e984e6af1585464d63ab85d48c0fabae
      https://github.com/MarquezProject/marquez/commit/5d048720e984e6af1585464d63ab85d48c0fabae
  Author: Renovate Bot <bot@...>
  Date:   2022-05-21 (Sat, 21 May 2022)

  Changed paths:
    M build.gradle

  Log Message:
  -----------
  chore(deps): update dependency io.openlineage:openlineage-java to v0.8.2

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] 357795: chore(deps): update helm release postgresql to v11...

GitHub

#186

Branch: refs/heads/renovate/postgresql-11.x
  Home:   https://github.com/MarquezProject/marquez
  Commit: 357795737b3d3622e8015b68e90284b7c2f24b34
      https://github.com/MarquezProject/marquez/commit/357795737b3d3622e8015b68e90284b7c2f24b34
  Author: Renovate Bot <bot@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M chart/Chart.lock
    M chart/Chart.yaml

  Log Message:
  -----------
  chore(deps): update helm release postgresql to v11.2.5

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] b9f0a1: chore(deps): update helm release common to v1.14.1

GitHub

#185

Branch: refs/heads/renovate/common-1.x
  Home:   https://github.com/MarquezProject/marquez
  Commit: b9f0a1629870d53f4b05808e6c79b9c1ab30ee41
      https://github.com/MarquezProject/marquez/commit/b9f0a1629870d53f4b05808e6c79b9c1ab30ee41
  Author: Renovate Bot <bot@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M chart/Chart.lock
    M chart/Chart.yaml

  Log Message:
  -----------
  chore(deps): update helm release common to v1.14.1

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] d68020: chore(deps): update dependency org.dhatim:dropwiza...

GitHub

#184

Branch: refs/heads/renovate/org.dhatim-dropwizard-sentry-2.x
  Home:   https://github.com/MarquezProject/marquez
  Commit: d68020bfd7136fa49b8dbd9935d9f2eef2f952a0
      https://github.com/MarquezProject/marquez/commit/d68020bfd7136fa49b8dbd9935d9f2eef2f952a0
  Author: Renovate Bot <bot@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/build.gradle

  Log Message:
  -----------
  chore(deps): update dependency org.dhatim:dropwizard-sentry to v2.1.0

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] 33f12d: chore(deps): update helm release postgresql to v11...

GitHub

#183

Branch: refs/heads/renovate/postgresql-11.1.x
  Home:   https://github.com/MarquezProject/marquez
  Commit: 33f12daf8c778f25ee0759000272c1b379eca39c
      https://github.com/MarquezProject/marquez/commit/33f12daf8c778f25ee0759000272c1b379eca39c
  Author: Renovate Bot <bot@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M chart/Chart.lock
    M chart/Chart.yaml

  Log Message:
  -----------
  chore(deps): update helm release postgresql to v11.1.29

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] b3ef3c: chore(deps): update dependency io.sentry:sentry to...

GitHub

#182

Branch: refs/heads/renovate/patch-sentryversion
  Home:   https://github.com/MarquezProject/marquez
  Commit: b3ef3c71bac89c02673e8473771641686f9c806d
      https://github.com/MarquezProject/marquez/commit/b3ef3c71bac89c02673e8473771641686f9c806d
  Author: Renovate Bot <bot@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/build.gradle

  Log Message:
  -----------
  chore(deps): update dependency io.sentry:sentry to v5.7.4

Signed-off-by: Renovate Bot <bot@...>

[MarquezProject/marquez] dd5f53: Job parent hierarchy api changes (#1992)

GitHub

#181

Branch: refs/heads/main
  Home:   https://github.com/MarquezProject/marquez
  Commit: dd5f53fe68e0faaf12125dbbe54de5692bbf4c07
      https://github.com/MarquezProject/marquez/commit/dd5f53fe68e0faaf12125dbbe54de5692bbf4c07
  Author: Michael Collado <40346148+collado-mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/db/Columns.java
    M api/src/main/java/marquez/db/JobDao.java
    M api/src/main/java/marquez/db/OpenLineageDao.java
    M api/src/main/java/marquez/db/RunDao.java
    M api/src/main/java/marquez/db/mappers/ExtendedRunRowMapper.java
    M api/src/main/java/marquez/db/mappers/JobDataMapper.java
    M api/src/main/java/marquez/db/mappers/JobMapper.java
    M api/src/main/java/marquez/db/mappers/JobRowMapper.java
    M api/src/main/java/marquez/db/models/ExtendedRunRow.java
    M api/src/main/java/marquez/db/models/JobData.java
    M api/src/main/java/marquez/db/models/JobRow.java
    M api/src/main/java/marquez/db/models/RunRow.java
    M api/src/main/java/marquez/service/models/Job.java
    M api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
    M api/src/test/java/marquez/OpenLineageIntegrationTest.java
    M api/src/test/java/marquez/db/BackfillTestUtils.java
    M api/src/test/java/marquez/db/DbTestUtils.java
    M api/src/test/java/marquez/db/RunDaoTest.java
    M api/src/test/java/marquez/db/mappers/JobMapperTest.java
    M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java
    M api/src/test/resources/mappers/full_job_mapper.json
    M clients/java/src/main/java/marquez/client/models/Job.java
    M clients/java/src/test/java/marquez/client/MarquezClientTest.java
    M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
    M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

  Log Message:
  -----------
  Job parent hierarchy api changes (#1992)

* Update API to write parent jobs and parent runs for OpenLineage events

Signed-off-by: Michael Collado <collado.mike@...>

* Added integration tests to verify behavior when recording Airflow jobs with parents

Signed-off-by: Michael Collado <collado.mike@...>

* Added integration test for airflow -> spark task recording

Signed-off-by: Michael Collado <collado.mike@...>

* Added simpleName field to Job model and updated integration tests

Signed-off-by: Michael Collado <collado.mike@...>

* Added parent job name to job models

Signed-off-by: Michael Collado <collado.mike@...>

[MarquezProject/marquez]

GitHub

#180

Branch: refs/heads/job_parent_hierarchy_api_changes
  Home:   https://github.com/MarquezProject/marquez

[MarquezProject/marquez] 716005: Update API to write parent jobs and parent runs fo...

GitHub

#179

Branch: refs/heads/job_parent_hierarchy_api_changes
  Home:   https://github.com/MarquezProject/marquez
  Commit: 716005c4ce3e1fdb00c632a0cd57fb5aa4c492be
      https://github.com/MarquezProject/marquez/commit/716005c4ce3e1fdb00c632a0cd57fb5aa4c492be
  Author: Michael Collado <collado.mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/db/Columns.java
    M api/src/main/java/marquez/db/JobDao.java
    M api/src/main/java/marquez/db/OpenLineageDao.java
    M api/src/main/java/marquez/db/RunDao.java
    M api/src/main/java/marquez/db/mappers/ExtendedRunRowMapper.java
    M api/src/main/java/marquez/db/mappers/JobRowMapper.java
    M api/src/main/java/marquez/db/models/ExtendedRunRow.java
    M api/src/main/java/marquez/db/models/JobRow.java
    M api/src/main/java/marquez/db/models/RunRow.java
    M api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
    M api/src/test/java/marquez/OpenLineageIntegrationTest.java
    M api/src/test/java/marquez/db/BackfillTestUtils.java
    M api/src/test/java/marquez/db/DbTestUtils.java
    M api/src/test/java/marquez/db/RunDaoTest.java
    M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java

  Log Message:
  -----------
  Update API to write parent jobs and parent runs for OpenLineage events

Signed-off-by: Michael Collado <collado.mike@...>


  Commit: 01f966dfdd4369774bd718ef8e9325b5eb568a8d
      https://github.com/MarquezProject/marquez/commit/01f966dfdd4369774bd718ef8e9325b5eb568a8d
  Author: Michael Collado <collado.mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/test/java/marquez/OpenLineageIntegrationTest.java

  Log Message:
  -----------
  Added integration tests to verify behavior when recording Airflow jobs with parents

Signed-off-by: Michael Collado <collado.mike@...>


  Commit: cee1d6686228e3740815fda4f0897d0a294e2f7b
      https://github.com/MarquezProject/marquez/commit/cee1d6686228e3740815fda4f0897d0a294e2f7b
  Author: Michael Collado <collado.mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/test/java/marquez/OpenLineageIntegrationTest.java

  Log Message:
  -----------
  Added integration test for airflow -> spark task recording

Signed-off-by: Michael Collado <collado.mike@...>


  Commit: 962d9cc603d62d54a23206e3bc4bf9bd5677bad1
      https://github.com/MarquezProject/marquez/commit/962d9cc603d62d54a23206e3bc4bf9bd5677bad1
  Author: Michael Collado <collado.mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/db/mappers/JobDataMapper.java
    M api/src/main/java/marquez/db/mappers/JobMapper.java
    M api/src/main/java/marquez/db/models/JobData.java
    M api/src/main/java/marquez/service/models/Job.java
    M api/src/test/java/marquez/OpenLineageIntegrationTest.java
    M api/src/test/java/marquez/db/mappers/JobMapperTest.java
    M api/src/test/resources/mappers/full_job_mapper.json
    M clients/java/src/main/java/marquez/client/models/Job.java
    M clients/java/src/test/java/marquez/client/MarquezClientTest.java
    M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
    M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

  Log Message:
  -----------
  Added simpleName field to Job model and updated integration tests

Signed-off-by: Michael Collado <collado.mike@...>


  Commit: b64b7f9eed50b892f32fad0829a5a856d19876a6
      https://github.com/MarquezProject/marquez/commit/b64b7f9eed50b892f32fad0829a5a856d19876a6
  Author: Michael Collado <collado.mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/db/Columns.java
    M api/src/main/java/marquez/db/mappers/JobDataMapper.java
    M api/src/main/java/marquez/db/mappers/JobMapper.java
    M api/src/main/java/marquez/db/mappers/JobRowMapper.java
    M api/src/main/java/marquez/db/models/JobData.java
    M api/src/main/java/marquez/db/models/JobRow.java
    M api/src/main/java/marquez/service/models/Job.java
    M api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
    M api/src/test/java/marquez/OpenLineageIntegrationTest.java
    M clients/java/src/main/java/marquez/client/models/Job.java
    M clients/java/src/test/java/marquez/client/MarquezClientTest.java
    M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

  Log Message:
  -----------
  Added parent job name to job models

Signed-off-by: Michael Collado <collado.mike@...>


Compare: https://github.com/MarquezProject/marquez/compare/b3880887ec19...b64b7f9eed50

[MarquezProject/marquez] 9d9770: Add java migrations for backfilling runs with job ...

GitHub

#178

Branch: refs/heads/main
  Home:   https://github.com/MarquezProject/marquez
  Commit: 9d9770817664128d37ce2523ab97bb66374ec31a
      https://github.com/MarquezProject/marquez/commit/9d9770817664128d37ce2523ab97bb66374ec31a
  Author: Michael Collado <40346148+collado-mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/common/Utils.java
    M api/src/main/java/marquez/db/FlywayFactory.java
    A api/src/main/java/marquez/db/migrations/V43_1__UpdateRunsWithJobUUID.java
    A api/src/main/java/marquez/db/migrations/V44_1__BackfillAirflowParentRuns.java
    A api/src/main/java/marquez/db/migrations/V44_2_BackfillJobsWithParents.java
    A api/src/test/java/marquez/db/BackfillTestUtils.java
    M api/src/test/java/marquez/db/LineageTestUtils.java
    A api/src/test/java/marquez/db/migrations/V44_1__BackfillAirflowParentRunsTest.java
    A api/src/test/java/marquez/db/migrations/V44_2_BackfillJobsWithParentsTest.java
    M api/src/test/java/marquez/jdbi/MarquezJdbiExternalPostgresExtension.java

  Log Message:
  -----------
  Add java migrations for backfilling runs with job uuids and parents (#1980)

* Add migrations to support job parent relationship storage

Signed-off-by: Michael Collado <collado.mike@...>

* Update all job and run queries to reference jobs_view and runs_view

Signed-off-by: Michael Collado <collado.mike@...>

* Remove references to simple_name as job redirects handle redirecting simple name to fqn
added unit test to verify

Signed-off-by: Michael Collado <collado.mike@...>

* Fix runs migration script

Signed-off-by: Michael Collado <collado.mike@...>

* Add java migrations for backfilling runs with job uuids and backfill Airflow runs
Signed-off-by: Michael Collado <collado.mike@...>

Signed-off-by: Michael Collado <collado.mike@...>

[MarquezProject/marquez]

GitHub

#177

Branch: refs/heads/job_parent_hierarchy_backfills
  Home:   https://github.com/MarquezProject/marquez

[MarquezProject/marquez] 736cc4: Add java migrations for backfilling runs with job ...

GitHub

#176

Branch: refs/heads/job_parent_hierarchy_backfills
  Home:   https://github.com/MarquezProject/marquez
  Commit: 736cc4b7461e55e44ea89d37662be558a303fb7c
      https://github.com/MarquezProject/marquez/commit/736cc4b7461e55e44ea89d37662be558a303fb7c
  Author: Michael Collado <collado.mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/common/Utils.java
    M api/src/main/java/marquez/db/FlywayFactory.java
    A api/src/main/java/marquez/db/migrations/V43_1__UpdateRunsWithJobUUID.java
    A api/src/main/java/marquez/db/migrations/V44_1__BackfillAirflowParentRuns.java
    A api/src/main/java/marquez/db/migrations/V44_2_BackfillJobsWithParents.java
    A api/src/test/java/marquez/db/BackfillTestUtils.java
    M api/src/test/java/marquez/db/LineageTestUtils.java
    A api/src/test/java/marquez/db/migrations/V44_1__BackfillAirflowParentRunsTest.java
    A api/src/test/java/marquez/db/migrations/V44_2_BackfillJobsWithParentsTest.java
    M api/src/test/java/marquez/jdbi/MarquezJdbiExternalPostgresExtension.java

  Log Message:
  -----------
  Add java migrations for backfilling runs with job uuids and backfill Airflow runs
Signed-off-by: Michael Collado <collado.mike@...>

Signed-off-by: Michael Collado <collado.mike@...>


  Commit: 55e0c6ea27f0a4f7eb75bc7c98195c78c79a02c9
      https://github.com/MarquezProject/marquez/commit/55e0c6ea27f0a4f7eb75bc7c98195c78c79a02c9
  Author: Michael Collado <collado.mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/common/Utils.java

  Log Message:
  -----------
  Fix javadoc in Utils

Signed-off-by: Michael Collado <collado.mike@...>


Compare: https://github.com/MarquezProject/marquez/compare/a53fe7402b6e...55e0c6ea27f0

[MarquezProject/marquez] 143e57: Update changelog for 0.22.0 (#1991)

GitHub

#175

Branch: refs/heads/job_parent_hierarchy_backfills
  Home:   https://github.com/MarquezProject/marquez
  Commit: 143e57cb8a28798d9b7c8ffb852cabe068f03b40
      https://github.com/MarquezProject/marquez/commit/143e57cb8a28798d9b7c8ffb852cabe068f03b40
  Author: Willy Lulciuc <willy@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M CHANGELOG.md

  Log Message:
  -----------
  Update changelog for 0.22.0 (#1991)

Signed-off-by: wslulciuc <willy@...>


  Commit: 497081d82de3272e946cd0e6e49bbbbe8e31a89f
      https://github.com/MarquezProject/marquez/commit/497081d82de3272e946cd0e6e49bbbbe8e31a89f
  Author: Michael Robinson <merobi@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M CHANGELOG.md

  Log Message:
  -----------
  Update changelog for 0.22.0

Signed-off-by: Michael Robinson <merobi@...>


  Commit: b00a6ecf842620d480738b9ea078c102418a8b58
      https://github.com/MarquezProject/marquez/commit/b00a6ecf842620d480738b9ea078c102418a8b58
  Author: Michael Robinson <merobi@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M chart/Chart.yaml
    M chart/values.yaml
    M clients/java/README.md
    M clients/python/marquez_client/__init__.py
    M clients/python/setup.cfg
    M clients/python/setup.py
    M docs/openapi.html
    M gradle.properties
    M spec/openapi.yml

  Log Message:
  -----------
  Prepare for release 0.22.0

Signed-off-by: Michael Robinson <merobi@...>


  Commit: a5347c936aa21578b9c097f18ae3efca2a95dca3
      https://github.com/MarquezProject/marquez/commit/a5347c936aa21578b9c097f18ae3efca2a95dca3
  Author: Michael Robinson <merobi@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M clients/python/marquez_client/__init__.py
    M clients/python/setup.cfg
    M clients/python/setup.py
    M gradle.properties
    M spec/openapi.yml

  Log Message:
  -----------
  Prepare next development version 0.23.0-SNAPSHOT

Signed-off-by: Michael Robinson <merobi@...>


  Commit: f78675c60893f53b8c98173ae509371a672fee97
      https://github.com/MarquezProject/marquez/commit/f78675c60893f53b8c98173ae509371a672fee97
  Author: Willy Lulciuc <willy@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M .circleci/config.yml
    M api/src/main/java/marquez/cli/SeedCommand.java

  Log Message:
  -----------
  Add javadoc check in CI (#1993)

* Use h2 for seed cli cmd docs

Signed-off-by: wslulciuc <willy@...>

* Add javadoc check in CI

Signed-off-by: wslulciuc <willy@...>

* continued: Add javadoc check in CI

Signed-off-by: wslulciuc <willy@...>


  Commit: daca35e2ab4e38614656405737f890b88b9ca641
      https://github.com/MarquezProject/marquez/commit/daca35e2ab4e38614656405737f890b88b9ca641
  Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M build.gradle

  Log Message:
  -----------
  chore(deps): update dependency com.diffplug.spotless:spotless-plugin-gradle to v6.6.1 (#1987)

Signed-off-by: Renovate Bot <bot@...>

Co-authored-by: Renovate Bot <bot@...>


  Commit: fc25b66f0d124a96b6c0bbe58549a8d1dc5a6046
      https://github.com/MarquezProject/marquez/commit/fc25b66f0d124a96b6c0bbe58549a8d1dc5a6046
  Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M build.gradle

  Log Message:
  -----------
  chore(deps): update dropwizard monorepo to v2.1.0 (#1985)

Signed-off-by: Renovate Bot <bot@...>

Co-authored-by: Renovate Bot <bot@...>
Co-authored-by: Willy Lulciuc <willy@...>


  Commit: 7ac652f89c20c6b547a935013a549b643fdbee34
      https://github.com/MarquezProject/marquez/commit/7ac652f89c20c6b547a935013a549b643fdbee34
  Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M build.gradle

  Log Message:
  -----------
  chore(deps): update dependency org.postgresql:postgresql to v42.3.5 (#1982)

Signed-off-by: Renovate Bot <bot@...>

Co-authored-by: Renovate Bot <bot@...>


  Commit: c5a6923fcff5b423ff0cf35fffadae5051110ad4
      https://github.com/MarquezProject/marquez/commit/c5a6923fcff5b423ff0cf35fffadae5051110ad4
  Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M api/build.gradle

  Log Message:
  -----------
  chore(deps): update dependency com.graphql-java:graphql-java to v18.1 (#1984)

Signed-off-by: Renovate Bot <bot@...>

Co-authored-by: Renovate Bot <bot@...>


  Commit: 7aed047b03573a01ae2e2154a231d83f1a1af72f
      https://github.com/MarquezProject/marquez/commit/7aed047b03573a01ae2e2154a231d83f1a1af72f
  Author: wslulciuc <willy@...>
  Date:   2022-05-17 (Tue, 17 May 2022)

  Changed paths:
    M CHANGELOG.md

  Log Message:
  -----------
  backfill changelog for 0.22.0

Signed-off-by: wslulciuc <willy@...>


  Commit: 878457bb938aeaccb69a6c8cca90ca9f8489a583
      https://github.com/MarquezProject/marquez/commit/878457bb938aeaccb69a6c8cca90ca9f8489a583
  Author: rejulius <7913608+rejulius@...>
  Date:   2022-05-18 (Wed, 18 May 2022)

  Changed paths:
    M docs/running-on-aws.md

  Log Message:
  -----------
  fixed key value input (#1995)

Signed-off-by: Julius Rentergent <julius.rentergent@...>

Co-authored-by: Julius Rentergent <julius.rentergent@...>


  Commit: 64ae1288a9158d4d6f6899b6467d3442b8815896
      https://github.com/MarquezProject/marquez/commit/64ae1288a9158d4d6f6899b6467d3442b8815896
  Author: Ryan Hatter <25823361+RNHTTR@...>
  Date:   2022-05-19 (Thu, 19 May 2022)

  Changed paths:
    M README.md

  Log Message:
  -----------
  Update Getting Started Guide with note on port 5000 for MacOS (#1994)

* Update Getting Started Guide with note on port 5000 for MacOS

Signed-off-by: Ryan Hatter <ryan.hatter@...>

* Update README.md

Signed-off-by: Ryan Hatter <ryan.hatter@...>

Co-authored-by: Willy Lulciuc <willy@...>


  Commit: 3fbe2f9b9aa0b60c584232d5111b22a83c72201c
      https://github.com/MarquezProject/marquez/commit/3fbe2f9b9aa0b60c584232d5111b22a83c72201c
  Author: Willy Lulciuc <willy@...>
  Date:   2022-05-19 (Thu, 19 May 2022)

  Changed paths:
    M README.md

  Log Message:
  -----------
  Add adopters section to readme (#1997)

Signed-off-by: wslulciuc <willy@...>


  Commit: ac7a4558343a52899263a4d83b05d0cffe51be92
      https://github.com/MarquezProject/marquez/commit/ac7a4558343a52899263a4d83b05d0cffe51be92
  Author: Ryan Hatter <25823361+RNHTTR@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M docker-compose.yml

  Log Message:
  -----------
  Randomly map postgres db port (#2000)

Signed-off-by: Ryan Hatter <ryan.hatter@...>

Co-authored-by: Ryan Hatter <ryan.hatter@...>


  Commit: 0021a2b7009ec84262af3c9a6403b9e80d017454
      https://github.com/MarquezProject/marquez/commit/0021a2b7009ec84262af3c9a6403b9e80d017454
  Author: Michael Collado <40346148+collado-mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/MarquezContext.java
    M api/src/main/java/marquez/api/JobResource.java
    M api/src/main/java/marquez/db/JobDao.java
    M api/src/main/java/marquez/db/JobVersionDao.java
    M api/src/main/java/marquez/db/LineageDao.java
    M api/src/main/java/marquez/db/OpenLineageDao.java
    M api/src/main/java/marquez/db/RunDao.java
    M api/src/main/java/marquez/db/SearchDao.java
    M api/src/main/java/marquez/graphql/GraphqlDaos.java
    M api/src/main/java/marquez/service/LineageService.java
    M api/src/main/java/marquez/service/RunService.java
    A api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
    A api/src/main/resources/marquez/db/migration/V44__runs_job_versions_add_job_uuid.sql
    M api/src/test/java/marquez/MarquezAppIntegrationTest.java
    M api/src/test/java/marquez/db/DbTestUtils.java
    M api/src/test/java/marquez/db/JobVersionDaoTest.java
    M api/src/test/java/marquez/db/RunDaoTest.java
    M api/src/test/java/marquez/service/LineageServiceTest.java

  Log Message:
  -----------
  Job parent hierarchy (#1935)

* Add migrations to support job parent relationship storage

Signed-off-by: Michael Collado <collado.mike@...>

* Update all job and run queries to reference jobs_view and runs_view

Signed-off-by: Michael Collado <collado.mike@...>

* Remove references to simple_name as job redirects handle redirecting simple name to fqn
added unit test to verify

Signed-off-by: Michael Collado <collado.mike@...>

* Fix runs migration script

Signed-off-by: Michael Collado <collado.mike@...>

* Rename sql migration script

Signed-off-by: Michael Collado <collado.mike@...>


  Commit: a53fe7402b6e21a87da3cd396fbe7045d7f3f70b
      https://github.com/MarquezProject/marquez/commit/a53fe7402b6e21a87da3cd396fbe7045d7f3f70b
  Author: Michael Collado <40346148+collado-mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M .circleci/config.yml
    M CHANGELOG.md
    M README.md
    M api/build.gradle
    M api/src/main/java/marquez/cli/SeedCommand.java
    A api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
    M build.gradle
    M chart/Chart.yaml
    M chart/values.yaml
    M clients/java/README.md
    M clients/python/marquez_client/__init__.py
    M clients/python/setup.cfg
    M clients/python/setup.py
    M docker-compose.yml
    M docs/openapi.html
    M docs/running-on-aws.md
    M gradle.properties
    M spec/openapi.yml

  Log Message:
  -----------
  Merge branch 'main' into job_parent_hierarchy_backfills


Compare: https://github.com/MarquezProject/marquez/compare/d7082b08f7e8...a53fe7402b6e

[MarquezProject/marquez]

GitHub

#174

Branch: refs/heads/job_parent_hierarchy
  Home:   https://github.com/MarquezProject/marquez

[MarquezProject/marquez] 0021a2: Job parent hierarchy (#1935)

GitHub

#173

Branch: refs/heads/main
  Home:   https://github.com/MarquezProject/marquez
  Commit: 0021a2b7009ec84262af3c9a6403b9e80d017454
      https://github.com/MarquezProject/marquez/commit/0021a2b7009ec84262af3c9a6403b9e80d017454
  Author: Michael Collado <40346148+collado-mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M api/src/main/java/marquez/MarquezContext.java
    M api/src/main/java/marquez/api/JobResource.java
    M api/src/main/java/marquez/db/JobDao.java
    M api/src/main/java/marquez/db/JobVersionDao.java
    M api/src/main/java/marquez/db/LineageDao.java
    M api/src/main/java/marquez/db/OpenLineageDao.java
    M api/src/main/java/marquez/db/RunDao.java
    M api/src/main/java/marquez/db/SearchDao.java
    M api/src/main/java/marquez/graphql/GraphqlDaos.java
    M api/src/main/java/marquez/service/LineageService.java
    M api/src/main/java/marquez/service/RunService.java
    A api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql
    A api/src/main/resources/marquez/db/migration/V44__runs_job_versions_add_job_uuid.sql
    M api/src/test/java/marquez/MarquezAppIntegrationTest.java
    M api/src/test/java/marquez/db/DbTestUtils.java
    M api/src/test/java/marquez/db/JobVersionDaoTest.java
    M api/src/test/java/marquez/db/RunDaoTest.java
    M api/src/test/java/marquez/service/LineageServiceTest.java

  Log Message:
  -----------
  Job parent hierarchy (#1935)

* Add migrations to support job parent relationship storage

Signed-off-by: Michael Collado <collado.mike@...>

* Update all job and run queries to reference jobs_view and runs_view

Signed-off-by: Michael Collado <collado.mike@...>

* Remove references to simple_name as job redirects handle redirecting simple name to fqn
added unit test to verify

Signed-off-by: Michael Collado <collado.mike@...>

* Fix runs migration script

Signed-off-by: Michael Collado <collado.mike@...>

* Rename sql migration script

Signed-off-by: Michael Collado <collado.mike@...>

[MarquezProject/marquez] 143e57: Update changelog for 0.22.0 (#1991)

GitHub

#172

Branch: refs/heads/job_parent_hierarchy
  Home:   https://github.com/MarquezProject/marquez
  Commit: 143e57cb8a28798d9b7c8ffb852cabe068f03b40
      https://github.com/MarquezProject/marquez/commit/143e57cb8a28798d9b7c8ffb852cabe068f03b40
  Author: Willy Lulciuc <willy@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M CHANGELOG.md

  Log Message:
  -----------
  Update changelog for 0.22.0 (#1991)

Signed-off-by: wslulciuc <willy@...>


  Commit: 497081d82de3272e946cd0e6e49bbbbe8e31a89f
      https://github.com/MarquezProject/marquez/commit/497081d82de3272e946cd0e6e49bbbbe8e31a89f
  Author: Michael Robinson <merobi@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M CHANGELOG.md

  Log Message:
  -----------
  Update changelog for 0.22.0

Signed-off-by: Michael Robinson <merobi@...>


  Commit: b00a6ecf842620d480738b9ea078c102418a8b58
      https://github.com/MarquezProject/marquez/commit/b00a6ecf842620d480738b9ea078c102418a8b58
  Author: Michael Robinson <merobi@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M chart/Chart.yaml
    M chart/values.yaml
    M clients/java/README.md
    M clients/python/marquez_client/__init__.py
    M clients/python/setup.cfg
    M clients/python/setup.py
    M docs/openapi.html
    M gradle.properties
    M spec/openapi.yml

  Log Message:
  -----------
  Prepare for release 0.22.0

Signed-off-by: Michael Robinson <merobi@...>


  Commit: a5347c936aa21578b9c097f18ae3efca2a95dca3
      https://github.com/MarquezProject/marquez/commit/a5347c936aa21578b9c097f18ae3efca2a95dca3
  Author: Michael Robinson <merobi@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M clients/python/marquez_client/__init__.py
    M clients/python/setup.cfg
    M clients/python/setup.py
    M gradle.properties
    M spec/openapi.yml

  Log Message:
  -----------
  Prepare next development version 0.23.0-SNAPSHOT

Signed-off-by: Michael Robinson <merobi@...>


  Commit: f78675c60893f53b8c98173ae509371a672fee97
      https://github.com/MarquezProject/marquez/commit/f78675c60893f53b8c98173ae509371a672fee97
  Author: Willy Lulciuc <willy@...>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M .circleci/config.yml
    M api/src/main/java/marquez/cli/SeedCommand.java

  Log Message:
  -----------
  Add javadoc check in CI (#1993)

* Use h2 for seed cli cmd docs

Signed-off-by: wslulciuc <willy@...>

* Add javadoc check in CI

Signed-off-by: wslulciuc <willy@...>

* continued: Add javadoc check in CI

Signed-off-by: wslulciuc <willy@...>


  Commit: daca35e2ab4e38614656405737f890b88b9ca641
      https://github.com/MarquezProject/marquez/commit/daca35e2ab4e38614656405737f890b88b9ca641
  Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M build.gradle

  Log Message:
  -----------
  chore(deps): update dependency com.diffplug.spotless:spotless-plugin-gradle to v6.6.1 (#1987)

Signed-off-by: Renovate Bot <bot@...>

Co-authored-by: Renovate Bot <bot@...>


  Commit: fc25b66f0d124a96b6c0bbe58549a8d1dc5a6046
      https://github.com/MarquezProject/marquez/commit/fc25b66f0d124a96b6c0bbe58549a8d1dc5a6046
  Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M build.gradle

  Log Message:
  -----------
  chore(deps): update dropwizard monorepo to v2.1.0 (#1985)

Signed-off-by: Renovate Bot <bot@...>

Co-authored-by: Renovate Bot <bot@...>
Co-authored-by: Willy Lulciuc <willy@...>


  Commit: 7ac652f89c20c6b547a935013a549b643fdbee34
      https://github.com/MarquezProject/marquez/commit/7ac652f89c20c6b547a935013a549b643fdbee34
  Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M build.gradle

  Log Message:
  -----------
  chore(deps): update dependency org.postgresql:postgresql to v42.3.5 (#1982)

Signed-off-by: Renovate Bot <bot@...>

Co-authored-by: Renovate Bot <bot@...>


  Commit: c5a6923fcff5b423ff0cf35fffadae5051110ad4
      https://github.com/MarquezProject/marquez/commit/c5a6923fcff5b423ff0cf35fffadae5051110ad4
  Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
  Date:   2022-05-16 (Mon, 16 May 2022)

  Changed paths:
    M api/build.gradle

  Log Message:
  -----------
  chore(deps): update dependency com.graphql-java:graphql-java to v18.1 (#1984)

Signed-off-by: Renovate Bot <bot@...>

Co-authored-by: Renovate Bot <bot@...>


  Commit: 7aed047b03573a01ae2e2154a231d83f1a1af72f
      https://github.com/MarquezProject/marquez/commit/7aed047b03573a01ae2e2154a231d83f1a1af72f
  Author: wslulciuc <willy@...>
  Date:   2022-05-17 (Tue, 17 May 2022)

  Changed paths:
    M CHANGELOG.md

  Log Message:
  -----------
  backfill changelog for 0.22.0

Signed-off-by: wslulciuc <willy@...>


  Commit: 878457bb938aeaccb69a6c8cca90ca9f8489a583
      https://github.com/MarquezProject/marquez/commit/878457bb938aeaccb69a6c8cca90ca9f8489a583
  Author: rejulius <7913608+rejulius@...>
  Date:   2022-05-18 (Wed, 18 May 2022)

  Changed paths:
    M docs/running-on-aws.md

  Log Message:
  -----------
  fixed key value input (#1995)

Signed-off-by: Julius Rentergent <julius.rentergent@...>

Co-authored-by: Julius Rentergent <julius.rentergent@...>


  Commit: 64ae1288a9158d4d6f6899b6467d3442b8815896
      https://github.com/MarquezProject/marquez/commit/64ae1288a9158d4d6f6899b6467d3442b8815896
  Author: Ryan Hatter <25823361+RNHTTR@...>
  Date:   2022-05-19 (Thu, 19 May 2022)

  Changed paths:
    M README.md

  Log Message:
  -----------
  Update Getting Started Guide with note on port 5000 for MacOS (#1994)

* Update Getting Started Guide with note on port 5000 for MacOS

Signed-off-by: Ryan Hatter <ryan.hatter@...>

* Update README.md

Signed-off-by: Ryan Hatter <ryan.hatter@...>

Co-authored-by: Willy Lulciuc <willy@...>


  Commit: 3fbe2f9b9aa0b60c584232d5111b22a83c72201c
      https://github.com/MarquezProject/marquez/commit/3fbe2f9b9aa0b60c584232d5111b22a83c72201c
  Author: Willy Lulciuc <willy@...>
  Date:   2022-05-19 (Thu, 19 May 2022)

  Changed paths:
    M README.md

  Log Message:
  -----------
  Add adopters section to readme (#1997)

Signed-off-by: wslulciuc <willy@...>


  Commit: ac7a4558343a52899263a4d83b05d0cffe51be92
      https://github.com/MarquezProject/marquez/commit/ac7a4558343a52899263a4d83b05d0cffe51be92
  Author: Ryan Hatter <25823361+RNHTTR@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M docker-compose.yml

  Log Message:
  -----------
  Randomly map postgres db port (#2000)

Signed-off-by: Ryan Hatter <ryan.hatter@...>

Co-authored-by: Ryan Hatter <ryan.hatter@...>


  Commit: a8ccb62d960a6fad5dc0c7c5f425ca1270d046e5
      https://github.com/MarquezProject/marquez/commit/a8ccb62d960a6fad5dc0c7c5f425ca1270d046e5
  Author: Michael Collado <40346148+collado-mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    M .circleci/config.yml
    M CHANGELOG.md
    M README.md
    M api/build.gradle
    M api/src/main/java/marquez/cli/SeedCommand.java
    M build.gradle
    M chart/Chart.yaml
    M chart/values.yaml
    M clients/java/README.md
    M clients/python/marquez_client/__init__.py
    M clients/python/setup.cfg
    M clients/python/setup.py
    M docker-compose.yml
    M docs/openapi.html
    M docs/running-on-aws.md
    M gradle.properties
    M spec/openapi.yml

  Log Message:
  -----------
  Merge branch 'main' into job_parent_hierarchy


Compare: https://github.com/MarquezProject/marquez/compare/31e628eac64d...a8ccb62d960a

[MarquezProject/marquez] 31e628: Rename sql migration script

GitHub

#171

Branch: refs/heads/job_parent_hierarchy
  Home:   https://github.com/MarquezProject/marquez
  Commit: 31e628eac64d4f53161359ab0dc2a34b303fb8a8
      https://github.com/MarquezProject/marquez/commit/31e628eac64d4f53161359ab0dc2a34b303fb8a8
  Author: Michael Collado <collado.mike@...>
  Date:   2022-05-20 (Fri, 20 May 2022)

  Changed paths:
    R api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_id.sql
    A api/src/main/resources/marquez/db/migration/V43__alter_jobs_add_job_parent_uuid.sql

  Log Message:
  -----------
  Rename sql migration script

Signed-off-by: Michael Collado <collado.mike@...>