pandasql (sqlite3.OperationalError) too many columns on df

[Ahrli]

An error is reported when df exceeds 3000 fields

How to solve?

[zbrookle]

@Ahrli Part of the performance issue with this package is that it uses SqLite as a backend, which means that you're essentially not using one of the main benefits of pandas, which is in memory computation. As a solution to this problem, a few months back I created a package called dataframe_sql, which solves this problem by parsing the sql and translating it to native pandas operations. Hope this helps!