Reminder: Marquez community meeting

When:
Thursday, March 23, 2023
11:00am to 12:00pm
(UTC-07:00) America/Los Angeles

Where:
https://us02web.zoom.us/j/89344845719?pwd=Y09RZkxMZHc2U3pOTGZ6SnVMUUVoQT09

Organizer: Marquez TSC

View Event

Description:
Marquez community meeting:

•  introductions
•  community topic discussion

Branch: refs/heads/renovate/pmd-6.x
Home: https://github.com/MarquezProject/marquez
Commit: c7274bc065dfc1dc53db841caf8b6e200746d531
https://github.com/MarquezProject/marquez/commit/c7274bc065dfc1dc53db841caf8b6e200746d531
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-25 (Sat, 25 Feb 2023)

Changed paths:
M build.gradle

Log Message:
-----------
fix(deps): update dependency pmd to v6.55.0

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/gradle.plugin.com.github.johnrengelman-shadow-8.x
Home: https://github.com/MarquezProject/marquez
Commit: ed3dad163295a6fc78fbff9ce99c8b072807ffda
https://github.com/MarquezProject/marquez/commit/ed3dad163295a6fc78fbff9ce99c8b072807ffda
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-25 (Sat, 25 Feb 2023)

Changed paths:
M build.gradle

Log Message:
-----------
fix(deps): update dependency gradle.plugin.com.github.johnrengelman:shadow to v8

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/gradle-8.x
Home: https://github.com/MarquezProject/marquez
Commit: 484cd5c7d00ec912a594d16d3e7105dcdb01e229
https://github.com/MarquezProject/marquez/commit/484cd5c7d00ec912a594d16d3e7105dcdb01e229
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-25 (Sat, 25 Feb 2023)

Changed paths:
M gradle/wrapper/gradle-wrapper.properties

Log Message:
-----------
chore(deps): update dependency gradle to v8

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/sentryversion
Home: https://github.com/MarquezProject/marquez
Commit: d77af3a9c02dca6a4dd16df3ba866ef4e167fd61
https://github.com/MarquezProject/marquez/commit/d77af3a9c02dca6a4dd16df3ba866ef4e167fd61
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-25 (Sat, 25 Feb 2023)

Changed paths:
M api/build.gradle

Log Message:
-----------
fix(deps): update dependency io.sentry:sentry to v6.14.0

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/pygithub-1.x
Home: https://github.com/MarquezProject/marquez
Commit: 8f70f4db5c149af0be4fde7129ec9b12c6866f47
https://github.com/MarquezProject/marquez/commit/8f70f4db5c149af0be4fde7129ec9b12c6866f47
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-25 (Sat, 25 Feb 2023)

Changed paths:
M stats/oss/requirements.txt

Log Message:
-----------
chore(deps): update dependency pygithub to v1.58.0

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/patch-dropwizard-monorepo
Home: https://github.com/MarquezProject/marquez
Commit: 26e01f9d15e0557b8c92ecd749ee1f38ea8c5111
https://github.com/MarquezProject/marquez/commit/26e01f9d15e0557b8c92ecd749ee1f38ea8c5111
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-25 (Sat, 25 Feb 2023)

Changed paths:
M build.gradle

Log Message:
-----------
fix(deps): update dropwizard monorepo to v2.1.5

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/patch-postgresqlversion
Home: https://github.com/MarquezProject/marquez
Commit: 62c826c0cf128357e41714dacb422fb008c29f99
https://github.com/MarquezProject/marquez/commit/62c826c0cf128357e41714dacb422fb008c29f99
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-25 (Sat, 25 Feb 2023)

Changed paths:
M build.gradle

Log Message:
-----------
fix(deps): update dependency org.postgresql:postgresql to v42.5.4

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/gradle-7.6.x
Home: https://github.com/MarquezProject/marquez
Commit: 739470aac846befd68eb702d6c7ed744af719aff
https://github.com/MarquezProject/marquez/commit/739470aac846befd68eb702d6c7ed744af719aff
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-25 (Sat, 25 Feb 2023)

Changed paths:
M gradle/wrapper/gradle-wrapper.properties

Log Message:
-----------
chore(deps): update dependency gradle to v7.6.1

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/dev/get-changes-script
Home: https://github.com/MarquezProject/marquez
Commit: dfb54bc28258684e16502aeaa2258a69abfa7754
https://github.com/MarquezProject/marquez/commit/dfb54bc28258684e16502aeaa2258a69abfa7754
Author: Michael Robinson <merobi@...>
Date: 2023-02-23 (Thu, 23 Feb 2023)

Changed paths:
M .github/pull_request_template.md

Log Message:
-----------
update pr template for automated updating of changelog

Signed-off-by: Michael Robinson <merobi@...>

Branch: refs/heads/dev/get-changes-script
Home: https://github.com/MarquezProject/marquez
Commit: 9fdab9ae51431fc85fb8c872189c547d0f54e035
https://github.com/MarquezProject/marquez/commit/9fdab9ae51431fc85fb8c872189c547d0f54e035
Author: Michael Robinson <merobi@...>
Date: 2023-02-23 (Thu, 23 Feb 2023)

Changed paths:
A dev/.gitignore
A dev/README.md
A dev/get_changes.sh
A dev/requirements.txt

Log Message:
-----------
add `get_changes` script in new dev dir for automating changelog updates

Signed-off-by: Michael Robinson <merobi@...>

Reminder: Marquez community meeting

When:
Thursday, February 23, 2023
11:00am to 12:00pm
(UTC-08:00) America/Los Angeles

Where:
https://us02web.zoom.us/j/89344845719?pwd=Y09RZkxMZHc2U3pOTGZ6SnVMUUVoQT09

Organizer: Marquez TSC

View Event

Description:
Marquez community meeting:

•  introductions
•  community topic discussion

Branch: refs/heads/main
Home: https://github.com/MarquezProject/marquez
Commit: 79a9c4f1427f5acb22c959196929e92065e90187
https://github.com/MarquezProject/marquez/commit/79a9c4f1427f5acb22c959196929e92065e90187
Author: JDarDagran <kuba0221@...>
Date: 2023-02-22 (Wed, 22 Feb 2023)

Changed paths:
M api/src/main/java/marquez/MarquezContext.java
M api/src/main/java/marquez/api/JobResource.java
M api/src/main/java/marquez/api/models/JobVersion.java
M api/src/main/java/marquez/common/Utils.java
M api/src/main/java/marquez/common/models/DatasetId.java
A api/src/main/java/marquez/common/models/FacetType.java
M api/src/main/java/marquez/db/BaseDao.java
M api/src/main/java/marquez/db/Columns.java
R api/src/main/java/marquez/db/JobContextDao.java
M api/src/main/java/marquez/db/JobDao.java
M api/src/main/java/marquez/db/JobFacetsDao.java
M api/src/main/java/marquez/db/JobVersionDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/RunFacetsDao.java
M api/src/main/java/marquez/db/mappers/ExtendedJobVersionRowMapper.java
R api/src/main/java/marquez/db/mappers/JobContextRowMapper.java
M api/src/main/java/marquez/db/mappers/JobDataMapper.java
A api/src/main/java/marquez/db/mappers/JobFacetsMapper.java
M api/src/main/java/marquez/db/mappers/JobMapper.java
M api/src/main/java/marquez/db/mappers/JobRowMapper.java
M api/src/main/java/marquez/db/mappers/JobVersionMapper.java
A api/src/main/java/marquez/db/mappers/RunFacetsMapper.java
M api/src/main/java/marquez/db/mappers/RunMapper.java
M api/src/main/java/marquez/db/models/ExtendedJobVersionRow.java
R api/src/main/java/marquez/db/models/JobContextRow.java
M api/src/main/java/marquez/db/models/JobRow.java
M api/src/main/java/marquez/db/models/JobVersionRow.java
M api/src/main/java/marquez/db/models/UpdateLineageRow.java
M api/src/main/java/marquez/graphql/GraphqlDaos.java
M api/src/main/java/marquez/graphql/GraphqlDataFetchers.java
M api/src/main/java/marquez/graphql/GraphqlSchemaBuilder.java
M api/src/main/java/marquez/service/DelegatingDaos.java
M api/src/main/java/marquez/service/models/Job.java
M api/src/main/java/marquez/service/models/JobData.java
A api/src/main/java/marquez/service/models/JobFacets.java
M api/src/main/java/marquez/service/models/JobMeta.java
M api/src/main/java/marquez/service/models/Run.java
A api/src/main/java/marquez/service/models/RunFacets.java
A api/src/main/resources/marquez/db/migration/V60__alter_job_versions_to_drop_job_context_uuid.sql
M api/src/main/resources/schema.graphqls
M api/src/test/java/marquez/BaseIntegrationTest.java
M api/src/test/java/marquez/DatasetIntegrationTest.java
M api/src/test/java/marquez/FlowIntegrationTest.java
M api/src/test/java/marquez/MarquezAppIntegrationTest.java
M api/src/test/java/marquez/RunIntegrationTest.java
A api/src/test/java/marquez/api/JobResourceTest.java
M api/src/test/java/marquez/common/UtilsTest.java
M api/src/test/java/marquez/common/api/JobResourceIntegrationTest.java
M api/src/test/java/marquez/common/models/CommonModelGenerator.java
M api/src/test/java/marquez/db/BackfillTestUtils.java
M api/src/test/java/marquez/db/DbTestUtils.java
M api/src/test/java/marquez/db/JobDaoTest.java
M api/src/test/java/marquez/db/JobFacetsDaoTest.java
M api/src/test/java/marquez/db/JobVersionDaoTest.java
M api/src/test/java/marquez/db/LineageDaoTest.java
M api/src/test/java/marquez/db/RunDaoTest.java
M api/src/test/java/marquez/db/RunFacetsDaoTest.java
M api/src/test/java/marquez/db/SearchDaoTest.java
A api/src/test/java/marquez/db/mappers/JobFacetsMapperTest.java
M api/src/test/java/marquez/db/mappers/JobMapperTest.java
A api/src/test/java/marquez/db/mappers/RunFacetsMapperTest.java
M api/src/test/java/marquez/service/OpenLineageServiceIntegrationTest.java
M api/src/test/java/marquez/service/models/NodeIdTest.java
M api/src/test/java/marquez/service/models/ServiceModelGenerator.java
A api/src/test/resources/facets/job_facets.json
A api/src/test/resources/facets/run_facets.json
A api/src/test/resources/mappers/job_facets_mapper.json
A api/src/test/resources/mappers/run_facets_mapper.json
M clients/java/src/main/java/marquez/client/models/Job.java
M clients/java/src/main/java/marquez/client/models/JobMeta.java
M clients/java/src/main/java/marquez/client/models/JobVersion.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/JobMetaTest.java
M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java
M lombok.config
M spec/openapi.yml
M web/src/components/datasets/DatasetInfo.tsx
M web/src/components/jobs/RunInfo.tsx
M web/src/components/lineage/types.ts
M web/src/helpers/nodes.ts
M web/src/store/actionCreators/actionTypes.ts
M web/src/store/actionCreators/index.ts
A web/src/store/reducers/facets.ts
M web/src/store/reducers/index.ts
A web/src/store/requests/facets.ts
M web/src/store/requests/index.ts
M web/src/store/sagas/index.ts
M web/src/types/api.ts

Log Message:
-----------
Remove job context. (#2373)

Add call to API in frontend.
Add tests.



Update javadocs.



Apply spotless fixes.



Remove FacetResource.
Split react functions to each component.



Add more tests for JobResource.
Update OpenAPI spec.



Add more tests.



Add lombok option to skip coverage check on NonNull.



Move find facets methods to corresponding daos.

Signed-off-by: Jakub Dardzinski <kuba0221@...>
Co-authored-by: Willy Lulciuc <willy@...>

Branch: refs/heads/inputFacets-write-and-expose
Home: https://github.com/MarquezProject/marquez
Commit: ede31dfd239186b5165ed44874a5f4d6e6998a58
https://github.com/MarquezProject/marquez/commit/ede31dfd239186b5165ed44874a5f4d6e6998a58
Author: Pawel Leszczynski <leszczynski.pawel@...>
Date: 2023-02-11 (Sat, 11 Feb 2023)

Changed paths:
M CHANGELOG.md
A api/src/main/java/marquez/common/models/RunDatasetFacets.java
M api/src/main/java/marquez/db/Columns.java
M api/src/main/java/marquez/db/DatasetDao.java
M api/src/main/java/marquez/db/DatasetFacetsDao.java
M api/src/main/java/marquez/db/DatasetVersionDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/mappers/RunMapper.java
M api/src/main/java/marquez/service/models/LineageEvent.java
M api/src/main/java/marquez/service/models/Run.java
M api/src/test/java/marquez/RunIntegrationTest.java
M api/src/test/java/marquez/db/DatasetFacetsDaoTest.java
M api/src/test/java/marquez/db/OpenLineageDaoTest.java
M clients/java/src/main/java/marquez/client/models/Run.java
A clients/java/src/main/java/marquez/client/models/RunDatasetFacets.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

Log Message:
-----------
implement inputFacets & outputFacets

Signed-off-by: Pawel Leszczynski <leszczynski.pawel@...>

Branch: refs/heads/inputFacets-write-and-expose
Home: https://github.com/MarquezProject/marquez
Commit: 857f23e8fb176c7da4873a290557eec9d66f4415
https://github.com/MarquezProject/marquez/commit/857f23e8fb176c7da4873a290557eec9d66f4415
Author: Pawel Leszczynski <leszczynski.pawel@...>
Date: 2023-02-11 (Sat, 11 Feb 2023)

Changed paths:
A api/src/main/java/marquez/common/models/RunDatasetFacets.java
M api/src/main/java/marquez/db/Columns.java
M api/src/main/java/marquez/db/DatasetDao.java
M api/src/main/java/marquez/db/DatasetFacetsDao.java
M api/src/main/java/marquez/db/DatasetVersionDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/mappers/RunMapper.java
M api/src/main/java/marquez/service/models/LineageEvent.java
M api/src/main/java/marquez/service/models/Run.java
M api/src/test/java/marquez/RunIntegrationTest.java
M api/src/test/java/marquez/db/DatasetFacetsDaoTest.java
M api/src/test/java/marquez/db/OpenLineageDaoTest.java
M clients/java/src/main/java/marquez/client/models/Run.java
A clients/java/src/main/java/marquez/client/models/RunDatasetFacets.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

Log Message:
-----------
implement inputFacets & outputFacets

Signed-off-by: Pawel Leszczynski <leszczynski.pawel@...>

Branch: refs/heads/inputFacets-write-and-expose
Home: https://github.com/MarquezProject/marquez
Commit: a8e74f5d853101d967ac5a0b0d38e7328c0d9224
https://github.com/MarquezProject/marquez/commit/a8e74f5d853101d967ac5a0b0d38e7328c0d9224
Author: Pawel Leszczynski <leszczynski.pawel@...>
Date: 2023-02-11 (Sat, 11 Feb 2023)

Changed paths:
A api/src/main/java/marquez/common/models/RunDatasetFacets.java
M api/src/main/java/marquez/db/Columns.java
M api/src/main/java/marquez/db/DatasetDao.java
M api/src/main/java/marquez/db/DatasetFacetsDao.java
M api/src/main/java/marquez/db/DatasetVersionDao.java
M api/src/main/java/marquez/db/OpenLineageDao.java
M api/src/main/java/marquez/db/RunDao.java
M api/src/main/java/marquez/db/mappers/RunMapper.java
M api/src/main/java/marquez/service/models/LineageEvent.java
M api/src/main/java/marquez/service/models/Run.java
M api/src/test/java/marquez/RunIntegrationTest.java
M api/src/test/java/marquez/db/DatasetFacetsDaoTest.java
M api/src/test/java/marquez/db/OpenLineageDaoTest.java
M clients/java/src/main/java/marquez/client/models/Run.java
A clients/java/src/main/java/marquez/client/models/RunDatasetFacets.java
M clients/java/src/test/java/marquez/client/MarquezClientTest.java
M clients/java/src/test/java/marquez/client/models/JsonGenerator.java
M clients/java/src/test/java/marquez/client/models/ModelGenerator.java

Log Message:
-----------
implement inputFacets & outputFacets

Signed-off-by: Pawel Leszczynski <leszczynski.pawel@...>

Branch: refs/heads/renovate/openlineageversion
Home: https://github.com/MarquezProject/marquez
Commit: 04a686cc43b4935295857562b694cdc5746ed3b2
https://github.com/MarquezProject/marquez/commit/04a686cc43b4935295857562b694cdc5746ed3b2
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-11 (Sat, 11 Feb 2023)

Changed paths:
M build.gradle

Log Message:
-----------
fix(deps): update dependency io.openlineage:openlineage-java to v0.20.6

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/com.diffplug.spotless-spotless-plugin-gradle-6.x
Home: https://github.com/MarquezProject/marquez
Commit: 6eaab3f1c1eacb61d038f7348a71a1b3a859ba93
https://github.com/MarquezProject/marquez/commit/6eaab3f1c1eacb61d038f7348a71a1b3a859ba93
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-11 (Sat, 11 Feb 2023)

Changed paths:
M build.gradle

Log Message:
-----------
fix(deps): update dependency com.diffplug.spotless:spotless-plugin-gradle to v6.15.0

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/renovate/patch-sentryversion
Home: https://github.com/MarquezProject/marquez
Commit: f008371b713436ed32130a55c4bd8bf0850c7977
https://github.com/MarquezProject/marquez/commit/f008371b713436ed32130a55c4bd8bf0850c7977
Author: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Date: 2023-02-11 (Sat, 11 Feb 2023)

Changed paths:
M api/build.gradle

Log Message:
-----------
fix(deps): update dependency io.sentry:sentry to v6.13.1

Signed-off-by: Renovate Bot <bot@...>

Branch: refs/heads/main
Home: https://github.com/MarquezProject/marquez
Commit: b86d126ae8928964a7bf534231c807aef19857f4
https://github.com/MarquezProject/marquez/commit/b86d126ae8928964a7bf534231c807aef19857f4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: 2023-02-09 (Thu, 09 Feb 2023)

Changed paths:
M web/package-lock.json

Log Message:
-----------
Bump json5 from 1.0.1 to 1.0.2 in /web (#2349)

Bumps [json5](https://github.com/json5/json5) from 1.0.1 to 1.0.2.
- [Release notes](https://github.com/json5/json5/releases)
- [Changelog](https://github.com/json5/json5/blob/main/CHANGELOG.md)
- [Commits](https://github.com/json5/json5/compare/v1.0.1...v1.0.2)

---
updated-dependencies:
- dependency-name: json5
dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@...>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Willy Lulciuc <willy@...>