I have been looking into Dremio and Arrow Flight recently and intrigued by the possibilities. One thing I’m not sure on is can you convert an Arrow Flight response to JSON easily with Java? Use case would be a service that interacts with Dremio using Arrow Flight to take advantage of the speed, but the client wants the response in JSON. I have been using this repo: https://github.com/dremio-hub/arrow-flight-client-examples and a local Dremio set up via docker.
Convert Arrow Flight Response to JSON
673 Views Asked by user12641216 At
1
There are 1 best solutions below
Related Questions in APACHE-ARROW-FLIGHT
- How do I locally host an Apache Arrow Flight server using Go and retrieve in Javascript?
- Error when trying to set PreparedStatement parameters
- Dremio SQL injection vulnerability
- pyarrow flight error: Could not finish writing before closing
- PyArrow Flight: Empty Strings in pa.Table Converting to NULLs When Reading/Writing to Exasol
- How to split apache arrow flight data into chunks in go
- How to read parquet files using DuckDB in Go?
- Can I use Apache Flight for sending and receiving byte data?
- Pyarrow flight server to expose custom endpoints
- Rust + Apache Flight: how to get around a library trait method defined on &self
- 2nd row is not getting inserted with BitVector in Apache Arrow Flight Sql in Java
- How do I enable TLS on an Apache Arrow FlightClient in Java?
- How do I convert a Polars DataFrame to Vec<RecordBatch>?
- Apache Arrow Flight: Releasing the flight stream that was created by GetFlightInfo
- Apache Arrow Flight: Getting sorted data from multiple endpoints
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Nothing is preventing you from converting Arrow data into JSON, you just need to decide how you will represent each of the format's type elements (primitives, binary, fixed/variable lists, structs, unions & null) in JSON. Most of them will have an obvious JSON counterpart, however binary will need to be encoded, e.g. as Base64. Once you have defined your mapping you need to implement it by using the Arrow API to extract the data and convert it.
However, converting the data to JSON does negate one of the primary benefits of using Arrow - bypassing serialisation/deserialisation costs. I.e. the goal should generally be to use Arrow end-to-end rather than converting it to another format like JSON.