Don't use take on dataset table in pyarrow 1.0.x
I tried lower batch sizes and it didn't accelerate filter (quite the opposite actually).
The slow-down also appears for pyarrow 0.17.1 for some reason, not sure it comes from these changes I just checked the benchmarks of other PRs and some of them had 300s (!!) for filter. This needs some investigation.. Merging this one since it's not the cause of the the slow down @lhoestq What might be the reason for the slowdown? When I was training large batchsize, the slowdown was obvious, and my original assumption was to increase write_batch_size
Fix #615 