Revert "Revert "Revert "Removing Pyarrow dependency (#7146)" (#7209) …

[simon-mo]

I believe this somehow caused core_worker_tests to hang in master.

[simon-mo]

[ RUN      ] SingleNodeTest.TestObjectInterface
I0219 13:26:33.531366 374885824 redis_gcs_client.cc:156] RedisGcsClient Connected.
W0219 13:26:33.742643 620936640 stats.h:50] Failed to create the Prometheus exporter. This doesn't affect anything except stats. Caused by: null context when constructing CivetServer. Possible problem binding to port.
I0219 13:26:33.747648 620936640 redis_gcs_client.cc:156] RedisGcsClient Connected.
I0219 13:26:33.748905 620936640 grpc_server.cc:44] ObjectManager server started, listening on port 59261.
I0219 13:26:33.749846 620936640 grpc_server.cc:44] NodeManager server started, listening on port 2000.
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0219 13:26:33.762295 338968000 core_worker.cc:105] Initializing worker ff6b40d33b8db183255e3a13bed1114927770951
I0219 13:26:33.763799 338968000 redis_gcs_client.cc:156] RedisGcsClient Connected.
I0219 13:26:33.764211 338968000 grpc_server.cc:44] worker server started, listening on port 59269.
E0219 13:26:33.832494 158236672 core_worker.cc:325] Raylet failed. Shutting down.
I0219 13:26:33.932762 333290944 core_worker.cc:105] Initializing worker 0100ffffffffffffffffffffffffffffffffffff
I0219 13:26:33.933656 333290944 redis_gcs_client.cc:156] RedisGcsClient Connected.
I0219 13:26:33.933820 333290944 grpc_server.cc:44] driver server started, listening on port 59276.
W0219 13:26:36.035897 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:38.037261 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:40.039168 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:42.040392 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:44.043381 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:46.047009 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:48.047554 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:50.049396 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:52.050827 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).
W0219 13:26:54.055287 620936640 node_manager.cc:2646] Metadata of task a959f0fadf0c330e4e4c984be393 not found in either GCS or lineage cache. It may have been evicted by the redis LRU configuration. Consider increasing the memory allocation via ray.init(redis_max_memory=<max_memory_bytes>).

[AmplabJenkins]

Can one of the admins verify this patch?

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/22134/
Test FAILed.