Jupyter Spark monitor

[vincentye38]

Implement a spark-monitor plugin to sent spark progress update to SparkMonitor frontend extension.
This plugin can be built as individual jar and enable by specifying --magic-url" args[7] = "file:///path/to/spark-monitor-plugin.jar"

[lresende]

Thank you for the contribution @vincentye38. Adding support for spark monitor will be a great addition to Toree kernel.

[lresende]

@vincentye38 could you take a look in the build failures?

[lresende]

@pan3793 any comments here?

[vincentye38]

@vincentye38 could you take a look in the build failures?

How to trigger the PR build again? looks like the build error is not related to my code change.

[lresende]

@vincentye38, when you rebase this pr it should re-run all the tests again.

[vincentye38]

thank you. The PR build is passed.

[vincentye38]

@lresende Any update?

[lresende]

Hi @vincentye38, some things I noticed :

• make commands were not building the jar automatically
• jar names were not being prefixed with toree
• rewrote the JSON parser using playjson to avoid adding new dependencies
• [] Magic URL is a bit strange, but I understand this is something that was already there

[lresende]

If no other comments, I will merge this tomorrow.

[vincentye38]

Hi @vincentye38, some things I noticed :

• make commands were not building the jar automatically
• jar names were not being prefixed with toree
• rewrote the JSON parser using playjson to avoid adding new dependencies
• [] Magic URL is a bit strange, but I understand this is something that was already there

Thank you @lresende for the enhancement. They looks good to me.

[pan3793]

@vincentye38 FYI, now Toree also supports Scala 2.13

• [TOREE-556] Support Scala 2.13 #218

Could you rebase this PR on the latest master, and make sure the patch works with both Scala 2.12 and 2.13?

[vincentye38]

Rebased on #218

[lresende]

Why are we adding the py4j dependency here?

[lresende]

Thank you @vincentye38 . LGTM