pg_bulkload is a high speed data loading utility for PostgreSQL
The pg_bulkload project is a PostgreSQL Community project that is a part of the pgFoundry. It is produced by NTT OSS Center.
The pgFoundry page for the project is at http://pgfoundry.org/projects/pgbulkload, where you can find downloads, documentation, bug reports, mailing lists, and a whole lot more.
| item | 8.1.8 | 8.2.3 |
| COPY(sec.) | 1601.4 | 1586.2 |
| pg_bulkload(sec.) | 147.7 | 131.8 |
| ratio | 10.8 | 12.0 |
| item | 8.1.8 | 8.2.3 |
| COPY(sec.) | 548.9 | 596.5 |
| pg_bulkload(sec.) | 147.7 | 131.8 |
| ratio | 4.17 | 4.04 |
| item | 8.1.8 | 8.2.3 |
| pg_bulkload to an indexed table | 147.7 | 131.8 |
| pg_bulkload to a non-indexed table | 72.5 | 72.9 |
| COPY to an indexed table | 1601.4 | 1586.2 |
| COPY to a non-indexed table | 127.7 | 140.2 |
| CREATE INDEX | 468.8 | 408.7 |
| Item | value |
| Machine | PowerEdge1900 |
| CPU | Dual Core Intel(R) Xeon(R) Processor5050 CPU3.0GHz |
| Memory | 2GB |
| Disc size (operating system installed) | SerialATA II 80GB |
| Storage size (database cluster stored) | RAID0 1.2TB |
| RAID Controller Cache | 128MB |
| Hyper Thread | ON |
| Version | RHEL ES release4 update4(32bit) |
| Kernel | 2.6.9-42.ELsmp |
| libc | 2.3.4 |
| Version | 8.1.8/8.2.3 |
| shared_buffers | 1024 |
| checkpoint_segments | 1000 |
| checkpoint_timeout | 3600 |
| work_mem | 1024 |
| maintenance_work_mem | 16384 |
| Table definition | DBT-2 customer table |
| Index column | c_id (PRIMARY KEY) |
| c_d_id (non-unique B-Tree) | |
| Constraint | Non-NULL (all columns) |
| Existing data | 16,777,216 tuples(4GB) |
| Loading data | 4,194,304 tuples(1GB) |
| Input file type | CSV |
| pg_bulkload version | pg_bulkload-2.1.2(PG-8.1.8)/2.2.0(PG-8.2.3) |