Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Remove check for
Nulls buffer
when null_count = 0
Summary: In PyArrow 6.0, it's legit for an arrow array to have non-null NullBuffer while null_count is zero (see also pytorch/torcharrow#109) : ``` import pyarrow as pa >>> pa.__version__ '6.0.0' >>> a = pa.array([1, 2, None, 3]) >>> a = a.fill_null(12) >>> a.buffers() [<pyarrow.lib.Buffer object at 0x7fe688222330>, <pyarrow.lib.Buffer object at 0x7fe6680c2ef0>] ``` User also reports similiar issue when converting arrow array reading from Parquet, see pytorch/torcharrow#146 (comment) Differential Revision: D33836988 fbshipit-source-id: bdb7277671eaf4fc25dfad46ed5bbe3272569ace
- Loading branch information