jobs from python client not showing up in Scheduler UI

[hokiegeek2]

Describe the bug
I am not totally sure this is a bug. The key thing is that I'm concerned that the ballista requests being submitted from my Python shell are not being distributed across my four-node cluster. I see the executors in the ui:

the ui is running here:

But I don't see any jobs:

![image](https://user-images.gu

but it appears jobs are running:

I also don't see anything in the logs, so not sure if I am missing a config somewhere?

[andygrove]

You need to use BallistaContext rather than SessionContext. See #595 for more details. Basically you are running thee query in DataFusion in the Python process and not in the Ballista cluster.

[hokiegeek2]

@andygrove thanks for the follow-up! On a hunch I did just that yesterday and got things working in terms of the sql API part:

so basically with BallistaContext the means to get a BallistaDataFrame is to execute a query against the sql API, works for me.

[hokiegeek2]

@andygrove closing this issue, thanks for the clarification (and reminder about #595)