Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Separate communication groups for different stages #54

Open
jsjason opened this issue Jun 23, 2015 · 3 comments
Open

Separate communication groups for different stages #54

jsjason opened this issue Jun 23, 2015 · 3 comments
Labels

Comments

@jsjason
Copy link
Contributor

jsjason commented Jun 23, 2015

We currently use a separate communication group for each stage. However, the user can't set the number of Tasks differently for each stage, which makes multiple communication groups pretty meaningless. What do you think, @kijungshin?

@kijungs
Copy link
Contributor

kijungs commented Jun 23, 2015

@jsjason It is difficult to reuse a communication group among stages because topologies and datatypes of communication are usually different.
What do you mean is simply using one communication group regardless of reusage?

@jsjason
Copy link
Contributor Author

jsjason commented Jun 23, 2015

The user doesn't use the communication group names anywhere other than when defining UserJobInfo.getStageInfoList(). Furthermore, the user would not care of the class name at all since the user doesn't need it in the algorithm itself. Thus I think it's better for Dolphin to hide the group names from the user.

@jsjason
Copy link
Contributor Author

jsjason commented Jun 23, 2015

I understand it's hard to actually implement a Dolphin core that hides the static group names, since the user can use an unbounded number of stages. Nonetheless, we shouldn't throw the group name definition burden to the user unless the user really needs to use those names.

@jsjason jsjason added the BSP label Sep 30, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants