Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance of this model #1

Open
lv2020 opened this issue Jan 24, 2021 · 2 comments
Open

Performance of this model #1

lv2020 opened this issue Jan 24, 2021 · 2 comments

Comments

@lv2020
Copy link

lv2020 commented Jan 24, 2021

Hi, thanks for you share. I'm doing a similar research on code generation and I also tried this model. But I haven't got a useful result yet. What I find is that generator only works on first 50 timesteps, and then it starts to generate some meaningless codes. So could you please share some details about this model, for example, the generated results, training settings and parameters? I think it is the problem of policy loss. Even in Seq GAN, they used sequences of length 20 to train the model, so it may be hard for the Tree GAN to work on a longer sequence. In my case, the median and mean length of training data are 837 and 900 respectively. Thanks.

@denizetkar
Copy link
Owner

denizetkar commented Jan 24, 2021

Thank you for the kind words and your interest. I must admit that this project is not complete yet. Because, it is still missing the training loop as well as the hyperparameter optimization. I'm currently doing a master's degree and I will hopefully finalize this project as soon as I get some free time.
I also should have mentioned in the README file that I was inspired by the following paper: https://arxiv.org/abs/1808.07582

@lv2020
Copy link
Author

lv2020 commented Jan 24, 2021

Thanks for your quick response. Actually I'm inspired by the same paper and this repo is the only related one I found in GitHub. Still, I doubt whether it works because C language has a much longer and deeper AST than examples in papers. Anyway, I think I will try some things like reduce the grammar rules to train this model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants