Skip to content
This repository has been archived by the owner on Nov 1, 2024. It is now read-only.

to_arrow doesn't work correctly on Map column #62

Open
wenleix opened this issue Nov 13, 2021 · 0 comments
Open

to_arrow doesn't work correctly on Map column #62

wenleix opened this issue Nov 13, 2021 · 0 comments

Comments

@wenleix
Copy link
Contributor

wenleix commented Nov 13, 2021

col = ta.Column([{"a": 1}, {"b1": 2, "b2": 3}])
col

0  {'a': 1}
1  {'b1': 2, 'b2': 3}
dtype: Map(string, int64), length: 2, null_count: 0

Result for to_arrow():

>>> col.to_arrow()
<pyarrow.lib.StructArray object at 0x7fcc78b432e0>
-- is_valid: all not null
-- child 0 type: int64
  [
    1,
    null
  ]
-- child 1 type: int64
  [
    null,
    2
  ]
-- child 2 type: int64
  [
    null,
    3
  ]
YLGH pushed a commit to YLGH/torcharrow that referenced this issue May 7, 2022
Summary:
This is an automated pull request to update the first-party submodule for [pytorch/FBGEMM](https://github.com/pytorch/FBGEMM).

New submodule commit: pytorch/FBGEMM@a358709

Pull Request resolved: pytorch/torchrec#62

Test Plan: Ensure that CI jobs succeed on GitHub before landing.

Reviewed By: jasonjk-park

Differential Revision: D34135477

fbshipit-source-id: 2e38653219597a4aea683f0da0468c9b50a08fda
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant