-
Notifications
You must be signed in to change notification settings - Fork 187
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
concat dataset #1411
base: main
Are you sure you want to change the base?
concat dataset #1411
Conversation
related to #1348 (comment) #1354 #1358 |
As mentioned here #1357 (comment), the current version has no API changes (except the type of dataset and collate_fn in However we don't actually need (But I find it hard to use |
/// </summary> | ||
/// <param name="index">Index for tensor</param> | ||
/// <returns>Tensors of index. DataLoader will catenate these tensors into batches.</returns> | ||
T this[long index] { get; } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Here we are using Int64
. However actually most .net containers does not support Int64
indices. And actually it is impractical to have so much data. Should we switch to Int32
instead?
torch.utils.data.ConcatDataset
IDataset<out T>
is addedDataset<T>
implementsIDataset<T>
DataLoader()
has been added, to acceptIDataset
datasetsDataLoader<T, S>
, rather than its subclassesDataLoader<T, S>
have been relaxed toIDataset<T>
DataLoader<T, S>
has been relaxed toIReadOnlyList