Date   

[MarquezProject/marquez] 99c879: continued: Set source and target compatibility to ...

GitHub
 

Branch: refs/heads/feature/run-id-support-on-job-meta
Home: https://github.com/MarquezProject/marquez
Commit: 99c8790f1106f70e987fb053ef0245d4734256a3
https://github.com/MarquezProject/marquez/commit/99c8790f1106f70e987fb053ef0245d4734256a3
Author: wslulciuc <willy@...>
Date: 2020-10-16 (Fri, 16 Oct 2020)

Changed paths:
M .circleci/get-jdk11.sh

Log Message:
-----------
continued: Set source and target compatibility to java 11

Signed-off-by: wslulciuc <willy@...>


[MarquezProject/marquez] 2da07a: [Gradle Release Plugin] - new version commit: '0....

GitHub
 

Branch: refs/heads/feature/run-id-support-on-job-meta
Home: https://github.com/MarquezProject/marquez
Commit: 2da07a1c36c8a57661b73c674848f679b90862aa
https://github.com/MarquezProject/marquez/commit/2da07a1c36c8a57661b73c674848f679b90862aa
Author: wslulciuc <willy@...>
Date: 2020-10-06 (Tue, 06 Oct 2020)

Changed paths:
M gradle.properties

Log Message:
-----------
[Gradle Release Plugin] - new version commit: '0.11.3-rc.4'.


Commit: 2c0e4dd7f49761850ee20a54f91f7b6b080e61c4
https://github.com/MarquezProject/marquez/commit/2c0e4dd7f49761850ee20a54f91f7b6b080e61c4
Author: Willy Lulciuc <willy@...>
Date: 2020-10-16 (Fri, 16 Oct 2020)

Changed paths:
M gradle.properties

Log Message:
-----------
Merge branch 'main' into feature/run-id-support-on-job-meta


Compare: https://github.com/MarquezProject/marquez/compare/99c8790f1106...2c0e4dd7f497


[MarquezProject/marquez] cba479: Use more descriptive var name in testApp_createJob...

GitHub
 

Branch: refs/heads/feature/run-id-support-on-job-meta
Home: https://github.com/MarquezProject/marquez
Commit: cba47991a6cdb0e9e6fad3229b543cdfd141a1c7
https://github.com/MarquezProject/marquez/commit/cba47991a6cdb0e9e6fad3229b543cdfd141a1c7
Author: wslulciuc <willy@...>
Date: 2020-10-16 (Fri, 16 Oct 2020)

Changed paths:
M src/test/java/marquez/MarquezAppIntegrationTest.java

Log Message:
-----------
Use more descriptive var name in testApp_createJobAndMarkRunAsComplete()

Signed-off-by: wslulciuc <willy@...>


Commit: 7a62fa853ac868456bfe6845369427ad57231a47
https://github.com/MarquezProject/marquez/commit/7a62fa853ac868456bfe6845369427ad57231a47
Author: wslulciuc <willy@...>
Date: 2020-10-16 (Fri, 16 Oct 2020)

Changed paths:
M gradle.properties

Log Message:
-----------
Merge branch 'feature/run-id-support-on-job-meta' of github.com:MarquezProject/marquez into feature/run-id-support-on-job-meta


Compare: https://github.com/MarquezProject/marquez/compare/2c0e4dd7f497...7a62fa853ac8


[MarquezProject/marquez] 36f932: Use ifPresent to check for run ID

GitHub
 

Branch: refs/heads/feature/run-id-support-on-job-meta
Home: https://github.com/MarquezProject/marquez
Commit: 36f932ba948f422afd7ec83a0435dc70283ee390
https://github.com/MarquezProject/marquez/commit/36f932ba948f422afd7ec83a0435dc70283ee390
Author: wslulciuc <willy@...>
Date: 2020-10-16 (Fri, 16 Oct 2020)

Changed paths:
M src/main/java/marquez/api/DatasetResource.java
M src/main/java/marquez/api/JobResource.java

Log Message:
-----------
Use ifPresent to check for run ID

Signed-off-by: wslulciuc <willy@...>


[MarquezProject/marquez] 34b9a9: Add run ID support on job meta (#818)

GitHub
 

Branch: refs/heads/main
Home: https://github.com/MarquezProject/marquez
Commit: 34b9a9c5a0110028824ae7e3fa0abf8fb7bc9319
https://github.com/MarquezProject/marquez/commit/34b9a9c5a0110028824ae7e3fa0abf8fb7bc9319
Author: Willy Lulciuc <willy@...>
Date: 2020-10-16 (Fri, 16 Oct 2020)

Changed paths:
M .circleci/config.yml
A .circleci/get-jdk11.sh
M build.gradle
M docs/openapi.html
M docs/openapi.yml
M src/main/java/marquez/api/DatasetResource.java
M src/main/java/marquez/api/JobResource.java
M src/main/java/marquez/db/Columns.java
M src/main/java/marquez/db/RunDao.java
M src/main/java/marquez/db/mappers/ExtendedRunRowMapper.java
M src/main/java/marquez/db/models/ExtendedRunRow.java
M src/main/java/marquez/db/models/RunRow.java
M src/main/java/marquez/service/JobService.java
M src/main/java/marquez/service/mappers/Mapper.java
M src/main/java/marquez/service/models/JobMeta.java
M src/test/java/marquez/MarquezAppIntegrationTest.java
M src/test/java/marquez/db/JobServiceTest.java
M src/test/java/marquez/service/JobServiceTest.java
M src/test/java/marquez/service/models/ModelGenerator.java

Log Message:
-----------
Add run ID support on job meta (#818)

* Add runID to job meta

Signed-off-by: wslulciuc <willy@...>

* Add logic to JobService to link runs when run ID present

Signed-off-by: wslulciuc <willy@...>

* Add RunDao.updateJobVersionUuid()

Signed-off-by: wslulciuc <willy@...>

* Log when an existing run is associated with a job version

Signed-off-by: wslulciuc <willy@...>

* Install jdk 11 in CI

Signed-off-by: wslulciuc <willy@...>

* Set source and target compatibility to java 11

Signed-off-by: wslulciuc <willy@...>

* Use ifPresent to check for run ID

Signed-off-by: wslulciuc <willy@...>


[MarquezProject/marquez]

GitHub
 

Branch: refs/heads/feature/run-id-support-on-job-meta
Home: https://github.com/MarquezProject/marquez


[MarquezProject/marquez]

GitHub
 

Branch: refs/tags/0.11.3-rc.4
Home: https://github.com/MarquezProject/marquez


[MarquezProject/marquez] c5402d: [Gradle Release Plugin] - new version commit: '0....

GitHub
 

Branch: refs/heads/main
Home: https://github.com/MarquezProject/marquez
Commit: c5402dc0c63fa064944a8ae1907204564470d7b2
https://github.com/MarquezProject/marquez/commit/c5402dc0c63fa064944a8ae1907204564470d7b2
Author: wslulciuc <willy@...>
Date: 2020-10-16 (Fri, 16 Oct 2020)

Changed paths:
M gradle.properties

Log Message:
-----------
[Gradle Release Plugin] - new version commit: '0.11.3-rc.5'.


Marquez Community Meeting (10/29)

willy@...
 

Hey everyone:

Our next community meeting will be this Thursday (10/29) at 10AM PST!

Where: https://us02web.zoom.us/j/89344845719?pwd=Y09RZkxMZHc2U3pOTGZ6SnVMUUVoQT09

Here's a few things that we'll be covering:
  • Intros
  • Demo Marquez UI with recent CSS updates
  • Demo Airflow integration with Marquez
Hope to see you there!


Re: Switch to slack for communication?

willy@...
 

Thanks, Julien. I agree that slack has become the standard for online communities.
I've created a workspace for Marquez and welcome others to join the discussion :) https://marquezproject.slack.com


marquez-web 0.7.0

willy@...
 

Our latest UI release (0.7.0) is out with enhanced data lineage graph rendering! Check it out here: https://github.com/MarquezProject/marquez-web/releases/tag/0.7.0


marquez-airflow 0.3.7

willy@...
 

More great news! We released 0.3.7 of our airflow integration which updates our postgres extractor to automatically fetch a tables schema, plus some sweet BigQuery updates


Join the Marquez slack channel!

willy@...
 

Hey, everyone:

We are now live on slack! To join the discussion, follow this invite link: https://join.slack.com/t/marquezproject/shared_invite/zt-izlcs3ar-V_mHjWkAUBBGEHuezX~ZgQ


Marquez Community Meeting (11/12)

willy@...
 

Hey everyone:

Our next community meeting is tomorrow Thursday, November 12th at 10AM PST (which will include a demo of our new data lineage graph rendering!)

Community Calendar: https://bit.ly/3llRv0F

Hope to see everyone there :)


Bi-Weekly Community Meeting on Thursday (tomorrow)

Sree Vaddi <sree_at_chess@...>
 

Details on our meetup group event page: https://www.meetup.com/marquez-hq/events/zcbrbsybcpbqb/


request to promote to contributor, again.

Sree Vaddi <sree_at_chess@...>
 

Hi Team,

My name is Sree Vaddi.  I am a Strategic Solutions Architect, Open Source Evangelist and an Apache IPMC.

I contributed significantly to the Marquez Projects.
One of my contributions of adding apache 2 log to Marquez projects saved Datakin at their first prospect customer trial on-boarding.

After leaving Datakin, I continued my contributions by running the linkedin group and meetup group.
And continued on code contributions, as well.

I was added to the contributor list and then was removed on leaving Datakin.

I request to add me back. This keeps my spirits up when working in Marquez Projects.


Thank you.
/Sree


Re: request to promote to contributor, again.

Julien Le Dem <julien.ledem@...>
 

Hello Sree,
Contributors can always be found on github https://github.com/MarquezProject/marquez/graphs/contributors
You'll find your contributions there along with other contributors. This is in the git history and immutable.
I have also updated the Contributors group on github to give more visibility to contributors: https://github.com/orgs/MarquezProject/teams/contributors
Thank you
Julien


On Tue, Dec 8, 2020 at 10:04 AM Sree Vaddi via lists.lfaidata.foundation <sree_at_chess=yahoo.com@...> wrote:
Hi Team,

My name is Sree Vaddi.  I am a Strategic Solutions Architect, Open Source Evangelist and an Apache IPMC.

I contributed significantly to the Marquez Projects.
One of my contributions of adding apache 2 log to Marquez projects saved Datakin at their first prospect customer trial on-boarding.

After leaving Datakin, I continued my contributions by running the linkedin group and meetup group.
And continued on code contributions, as well.

I was added to the contributor list and then was removed on leaving Datakin.

I request to add me back. This keeps my spirits up when working in Marquez Projects.


Thank you.
/Sree


Marquez Community Meeting (12/10)

willy@...
 

Hey everyone:

Our next community meeting is tomorrow Thursday, December 10th at 10AM PST.
Community Calendar: https://bit.ly/3oAimY8

Hope to see everyone there!


request for permission

Sree Vaddi <sree_at_chess@...>
 

Hi Project Governance Body,


I have been contributing to the Marquez project for a few months.

I request to use Marquez name, logo and related on social media (eg. linkedin, meetup) and websites (eg.github) and presentation/talks in conferences to aid promote the project.


Thank you.
/Sree


Re: request for permission

Sree Vaddi <sree_at_chess@...>
 

Buddy,

If you want such a strict control your project keep it in your home. Why open source it ? and waste people's time.

Contributor's Lives Matter.


Thank you.
/Sree


On Wednesday, December 9, 2020, 11:55:33 AM PST, Ibrahim Haddad <ibrahim@...> wrote:


Hi Sree,

Please stop spamming our mailing lists. I just replied to you in another thread.

Ibrahim


On Wed, Dec 9, 2020, 9:03 PM Sree Vaddi <sree_at_chess@...> wrote:
Hi Project Governance Body,


I have been contributing to the Marquez project for a few months.

I request to use Marquez name, logo and related on social media (eg. linkedin, meetup) and websites (eg.github) and presentation/talks in conferences to aid promote the project.


Thank you.
/Sree