Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Spark master as local[*] in TaskManager #1666

Closed
tobegit3hub opened this issue Apr 20, 2022 · 0 comments · Fixed by #1675
Closed

Support Spark master as local[*] in TaskManager #1666

tobegit3hub opened this issue Apr 20, 2022 · 0 comments · Fixed by #1675
Assignees
Labels
bug Something isn't working task-manager openmldb taskmanager
Milestone

Comments

@tobegit3hub
Copy link
Collaborator

Now TaskManager will check spark.master and local[*] is not supported yet.

        SPARK_MASTER = prop.getProperty("spark.master", "local").toLowerCase();
        if (!Arrays.asList("local", "yarn", "yarn-cluster", "yarn-client").contains(SPARK_MASTER) ) {
            throw new ConfigException("spark.master", "should be one of local, yarn, yarn-cluster or yarn-client");
        }
@tobegit3hub tobegit3hub added bug Something isn't working task-manager openmldb taskmanager labels Apr 20, 2022
@tobegit3hub tobegit3hub added this to the v0.5 milestone Apr 20, 2022
@tobegit3hub tobegit3hub self-assigned this Apr 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working task-manager openmldb taskmanager
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant