Heavy Duty Backup with PgBackRest (PGCon 2015)

PgBackRest is open source software developed to perform efficient backup on PostgreSQL databases that measure in tens of terabytes and greater. It supports per file checksums, compression, partial/failed backup resume, high-performance parallel transfer, asynchronous archiving, tablespaces, expiration, full/differential/incremental, local/remote operation via SSH, hard-linking, restore, and more. PgBackRest is written in Perl and does not depend on rsync or tar but instead performs its own deltas which gives it maximum flexibility. This talk by the author will introduce the features, give sample configurations, and talk about design philosophy.

Bio:

David Steele is Senior Data Architect at Crunchy Data Solutions, the PostgreSQL company for secure enterprises. He has been actively developing with PostgreSQL since 1999.

Efficiently Backing up Terabytes of Data with PgBackRest (NYC PUG 2015)

PgBackRest is open source software developed to perform efficient backup on PostgreSQL databases that measure in tens of terabytes and greater. It supports per file checksums, compression, partial/failed backup resume, high-performance parallel transfer, asynchronous archiving, tablespaces, expiration, full/differential/incremental, local/remote operation via SSH, hard-linking, restore, and more. PgBackRest is written in Perl and does not depend on rsync or tar but instead performs its own deltas which gives it maximum flexibility. This talk by the author will introduce the features, give sample configurations, and talk about design philosophy.

Bio:

David Steele is Senior Data Architect at Crunchy Data Solutions, the PostgreSQL company for secure enterprises. He has been actively developing with PostgreSQL since 1999.

Heavy Duty Backup with PgBackRest (PostgresOpen 2014)

PgBackRest is a backup system developed at Resonate and open sourced to address issues around the backup of multi-terabyte databases. It supports per file checksums, compression, partial/failed backup resume, high-performance parallel transfer, async archiving, tablespaces, expiration, full/differential/incremental, local/remote operation via SSH, hard-linking, and more. PgBackRest is written in Perl and uses common (and configurable) command line tools, but does not depend on rsync or tar and instead performs its own deltas which gives it maximum flexibility. It works with any file system that provides snapshots to allow easy access to data by starting a cluster directly on the backup. This talk will introduce the features, give sample configurations, and talk about design philosophy.

Bio:

David Steele is the Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. He has been actively developing with PostgresSQL since 1999.

Database Validation and Versioning (PGConf NYC 2014)

There are many advantages to maintaining full build scripts for your database. They allow you to create your database from scratch, run unit tests, and serve as a useful reference to the current state of the database. However, in production full build scripts are only run once per database. After that it is an endless sequence of update scripts. How do you to keep the full build and update scripts in sync? How can you be sure that your production database looks exactly like your full build once all the updates have been applied? In this talk we’ll examine how validation and versioning can be used to ensure that production databases always match full builds even after thousands of updates have been applied. There will be practical demonstrations using tools such as check_postgres and sqitch.

Bio:

David Steele is the Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. He has been actively developing with PostgresSQL since 1999.