You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I prodded at pyarrow compute functions to try to make a in/out tree of their functions and came up with this. The first file is the script and the second is the json output (so you don't have to run the first).
About the results
The first key is the name of the pyarrow compute function. Within each of those the keys are keys of output types. For one parameter functions, the value is the list of input types that result in that output. For two parameter functions the value is a 3 element list. The first two elements are the first two paramters' types respectively. The third element is a bool indicating if the second parameter was a scalar (False is array).
I'm assuming that all one parameter functions can take a Scalar or Array and that two parameter functions take only an Array as the first parameter. (As I type that, I'm less happy with that assumption than when I did the code)
About the process
I originally just used a basic try except for every attempted function call but on some of the two parameter functions it would crash the kernel so I had to hack up the multiprocessing approach so that it would crash the kernel of a separate process and could keep running. The one parameter functions finished in about a second but adding in the two parameter functions made it take over 10 minutes.
for example in compute.pyi
etc.
The text was updated successfully, but these errors were encountered: