Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible to have more than one streaming datasource? #15

Open
bronzels opened this issue Jun 19, 2021 · 1 comment
Open

Possible to have more than one streaming datasource? #15

bronzels opened this issue Jun 19, 2021 · 1 comment

Comments

@bronzels
Copy link

Dear jMetalSP commiters,

as optimization with large dataset usually takes long time, your streaming idea to add new data is brilliant to me. but my problem to resolve involves 2 kinds of data which is difficult to put into one class. as titles, any way to have more than one streaming datasource?

@cbarba
Copy link
Contributor

cbarba commented Jun 22, 2021

Of course, you can have more than one streaming datasource. You only need to add as observable the same problem. I mean, more than one streaming datasource can change the same problem, because our methods are synchronized . For example, for the TSP problem,you can add more than one streaming data source:

application.setStreamingRuntime(new SparkRuntime(10, sparkConf))
.setProblem(problem)
.setAlgorithm(algorithm)
.addStreamingDataSource(streamingTSPSource,problem)
.addStreamingDataSource(streamingTSPSource2,problem)
.addStreamingDataSource(streamingTSPSource3,problem)
.addAlgorithmDataConsumer(localDirectoryOutputConsumer)
.addAlgorithmDataConsumer(chartConsumer)
.run();

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants