pg_bulkload is a high speed data loading utility for PostgreSQL
The pg_bulkload project is a PostgreSQL Community project that is a part of the pgFoundry. It is produced by NTT OSS Center.
The pgFoundry page for the project is at http://pgfoundry.org/projects/pgbulkload, where you can find downloads, documentation, bug reports, mailing lists, and a whole lot more.
item | 8.1.8 | 8.2.3 |
COPY(sec.) | 1601.4 | 1586.2 |
pg_bulkload(sec.) | 147.7 | 131.8 |
ratio | 10.8 | 12.0 |
item | 8.1.8 | 8.2.3 |
COPY(sec.) | 548.9 | 596.5 |
pg_bulkload(sec.) | 147.7 | 131.8 |
ratio | 4.17 | 4.04 |
item | 8.1.8 | 8.2.3 |
pg_bulkload to an indexed table | 147.7 | 131.8 |
pg_bulkload to a non-indexed table | 72.5 | 72.9 |
COPY to an indexed table | 1601.4 | 1586.2 |
COPY to a non-indexed table | 127.7 | 140.2 |
CREATE INDEX | 468.8 | 408.7 |
Item | value |
Machine | PowerEdge1900 |
CPU | Dual Core Intel(R) Xeon(R) Processor5050 CPU3.0GHz |
Memory | 2GB |
Disc size (operating system installed) | SerialATA II 80GB |
Storage size (database cluster stored) | RAID0 1.2TB |
RAID Controller Cache | 128MB |
Hyper Thread | ON |
Version | RHEL ES release4 update4(32bit) |
Kernel | 2.6.9-42.ELsmp |
libc | 2.3.4 |
Version | 8.1.8/8.2.3 |
shared_buffers | 1024 |
checkpoint_segments | 1000 |
checkpoint_timeout | 3600 |
work_mem | 1024 |
maintenance_work_mem | 16384 |
Table definition | DBT-2 customer table |
Index column | c_id (PRIMARY KEY) |
c_d_id (non-unique B-Tree) | |
Constraint | Non-NULL (all columns) |
Existing data | 16,777,216 tuples(4GB) |
Loading data | 4,194,304 tuples(1GB) |
Input file type | CSV |
pg_bulkload version | pg_bulkload-2.1.2(PG-8.1.8)/2.2.0(PG-8.2.3) |