Answer by Frank Heikens for Huge database logging of event type rows and ways...
We have something simular, ~5000 events per seconds. Tables are partitioned by month and we store 5 years of data. That gives us a 60 partitions, works fine. It runs on PostgreSQL version 9.1, works...
View ArticleAnswer by Frank Heikens for Created user can access all databases in...
PUBLIC has access to the database by default, but it can't access the data. You can REVOKE the PUBLIC:REVOKE CONNECT ON DATABASE your_database FROM PUBLIC;If you want this setting for all future...
View ArticleAnswer by Frank Heikens for Perf of query of large table by date?
We do 500 to 3000 inserts per second on a table, but in partitions of 1 month, and are monitoring the last 2 hours of activity. An index on the timestamp does the trick, most queries run less than a...
View ArticleAnswer by Frank Heikens for Automating failover in PostgreSQL 9.1
Check out repmrg:repmgr is a set of open source tools that helps DBAs and System administrators manage a cluster of PostgreSQL databases..By taking advantage of the Hot Standby capability introduced in...
View ArticleAnswer by Frank Heikens for Postgresql: Two concurrent COPY FROM
It just works, like it should. It doesn't lock the table, so start testing.
View ArticleAnswer by Frank Heikens for Trying to create PostGIS database
You must install the PostGIS functions, data types, etc. before you can use PostGIS. This can be found in these three SQL-files. Set the correct path to the files and execute them in PostgreSQL by...
View ArticleAnswer by Frank Heikens for Unit testing of stored procedures
For PostgreSQL, check out pgTAP:pgTAP is a suite of database functions that make it easy to write TAP-emitting unit tests in psql scripts or xUnit-style test functions.
View ArticleAnswer by Frank Heikens for Streaming replication and failover on PostgreSQL
In our shop we selected repmgr and pgbouncer instead of pgpool. repmgr has some nice tooling to setup and maintain the cluster of replicated database servers. In our case 1 master and 2 slaves (one...
View ArticleAnswer by Frank Heikens for Can you make SSL and SSL-only (hostssl)...
I'm not sure about pgPool, but pgBouncer (another connection pool) can use SSL by using Stunnel.Check your functional requirements to see if pgBouncer can solve your problem. Maybe pgPool can also use...
View ArticleAnswer by Frank Heikens for Benefits of using backtick (`) in MySQL queries?
If you want to use something around object identifiers, use at least the standard double quotes: "This works in MySQL, PostgreSQL, SQL Server, Oracle, etc. etc. For MySQL you might need the SQL...
View ArticleAnswer by Frank Heikens for SQL Server Express vs. Oracle Express Edition vs...
In my view, DB2 is the clear cut winner.What about PostgreSQL:cores: unlimitedmem: unlimitedsize: unlimitedlicense: PostgreSQL (BSD style)imho, PostgreSQL beats all Express/cripled databases.
View ArticleAnswer by Frank Heikens for What GUI tools can be used for PostgreSQL in Mac...
Check the wiki page, many different tools available.
View ArticleAnswer by Frank Heikens for Too many TIME_WAIT connections in PostgreSQL
1500 to 2200 concurrent connections are only useful when you need them. Otherwise, bring the total number of open connections down and start using a connection pool like pgBouncer or PgPool-II. See...
View ArticleAnswer by Frank Heikens for PostgreSQL replication and large import
PostgreSQL out of the box replication has one master and can have multiple (cascading, as of version 9.2) slaves. If you need multi master replication, 2 masters in your case, you need Postgres-XC.My...
View ArticleAnswer by Frank Heikens for Locking issue with concurrent DELETE / INSERT in...
Use a DEFERRABLE primary key and try again.
View ArticleAnswer by Frank Heikens for Manually increase PostgreSQL's table size limit...
Just use a different setting for the block size:--with-blocksize=BLOCKSIZEThe default, 8 kilobytes, is suitable for most situations; but other values may be useful in special cases. The value must be a...
View ArticleAnswer by Frank Heikens for Does running pg_dump on live db produce...
From the manual:It makes consistent backups even if the database is being used concurrently.So yes, you can trust the backup. Of course, it's PostgreSQL, you can trust your data in PostgreSQL.
View ArticleAnswer by Frank Heikens for PostgreSQL procedural languages overhead...
Is the context a big overhead? Can I use it for realtime data mapping (let's say 1000 queries/s))Performance depends on hardware and complexity of your functions. I created an appliance that ran on a...
View ArticleAnswer by Frank Heikens for PostgreSQL partitioning query performance...
What version do you use? Version 9.1 has a major improvement for partitioning, check this blog from Greg Smith.When using version 9.1, I get this result for this queryEXPLAIN ANALYZESELECT MAX(logdate)...
View ArticleAnswer by Frank Heikens for How do I list all databases and tables using psql?
Please note the following commands:\list or \l: list all databases\c <db name>: connect to a certain database\dt: list all tables in the current database using your search_path\dt *.: list all...
View Article