Have you considered sqlglot? #4648
Replies: 3 comments 1 reply
-
|
@chitralverma thanks for the discussion. We've been referred to sqlglot a few times to convert from/to our dialect (we invite contributions!). That said, I doubt sqlglot is a substitute for Apache Calcite in any serious capacity; syntactically translating between dialects is not the same as a full-featured SQL frontend, optimizer and compiler infrastructure. Datafusion would be a better comparison point, but at the time we started this project, it was pretty nascent. Do you know of projects that managed to do such a replacement? |
Beta Was this translation helpful? Give feedback.
-
I also saw differences between "Feldera SQL", (i assume a custom dialect) and Adhoc SQL (things that run on Datafusion). my suggestion was to use sqlglot to transpile a SQL query (adhoc or otherwise) in some dialect (spark, duckdb ... ) to Feldera SQL dialect (a subset of an engine dialect) which runs either as a pipeline or an adhoc query over the chosen engine (datafusion/ duckdb ... ). sqlglot is just for conversion not for actually running the query.
I know of a few projects which transpile for a given engine/ runtime, like this. maybe i missed something here, but anyway, just wanted to drop the idea here. :) |
Beta Was this translation helpful? Give feedback.
-
|
Having a tool to port programs to Feldera SQL would be very useful. Calcite is not even a dialect, it has a large number of configuration knobs that can make it look like other dialects to some degree, but it doesn't really match any one exactly. We don't use its default settings, and some of the functions which we consider "wrong" we reimplement in a different way, when we can. But perhaps people would be happy with just a coarse transformation, which they can tweak by hand. But for this purpose some of our customers have used LLMs quite successfully. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi awesome initiative here.
Just wanted to check if you all have considered sqlglot[rs] as a replacement of Apache calcite for transpiling and optimising queries thereby removing the java bloat?
Beta Was this translation helpful? Give feedback.
All reactions