Could bigflow support either SQL or a familiar DataFrame API to query structured data.

[kelvict]

Could bigflow support either SQL or a familiar DataFrame API to query structured data.

[yshysh]

Bigflow will support this follow-up.

[yshysh]

We have a version of Bigflow on schema, but this version needs to improve, for example, only supportting input, process sql is on the way.

[acmol]

We'd like to implement a Spark SQL familiar framework, but it's not a easy task.

We've implement a prototype, named Bigflow Schema, it's available inside Baidu.
But it has a lot of problems if there are too many fields. So it's not recommended to use.

More time is needed to consider, design, and implement this.