Skip to content

Better hint sniffing, initial GCS bucket support

Compare
Choose a tag to compare
@vinceatbluelabs vinceatbluelabs released this 01 Jun 16:14

Breaking changes:

  • If you are relying on CSV hint inference in production, see detail on #57 and test carefully to ensure the new engine works correctly for your files.

New features:

  • Default db-facts and credential objects for databases, AWS and GCP can be passed directly into Session() (#68)
  • Initial support for GCS buckets, allowing for copying files to and from them. This does not yet include bulk loading and unloading directly to/from these buckets. (#61)
  • Records mover understands many more types of CSV files without being given explicit records format information. Hint inference now covers many additional types of hints. (#57)
  • Support for a new user- or system-level configuration mechanism, initially used for S3 scratch buckets. (#47)

Bug fixes / reliability improvements:

  • Better error message when processing zero byte CSV files. (#65)
  • Address inconsistencies in records specs around CSV date/time hints (#63)

Other updates:

  • Internal improvements doing validation on CSV hints (#55)