Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pt2e workflow for torch >= 2.5 #211

Open
shivadbhavsar opened this issue Nov 12, 2024 · 0 comments
Open

Pt2e workflow for torch >= 2.5 #211

shivadbhavsar opened this issue Nov 12, 2024 · 0 comments
Assignees
Labels
TorchMIGraphX For internal tracking

Comments

@shivadbhavsar
Copy link
Collaborator

The current set of calls:

torch.export.export -> prepare_pt2e -> convert_pt2e -> torch.compile

has different behavior then previously. The quantization params are lifted to inputs (rather than being static parameters) by torch.compile and there is no simple switch for disabling this behavior.

Requires further investigation and potential rework for the pt2e workflow in general (possibly to just directly convert exported model wihtout using torch.compile). This needs a few additional converters and updates in lowering passes.

@shivadbhavsar shivadbhavsar added the TorchMIGraphX For internal tracking label Nov 12, 2024
@shivadbhavsar shivadbhavsar self-assigned this Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
TorchMIGraphX For internal tracking
Projects
None yet
Development

No branches or pull requests

1 participant