Alert Templates v8
An alert definition contains a system-defined or user-defined set of conditions that PEM compares to the system statistics; if the statistics deviate from the boundaries specified for that statistic, the alert triggers, and the PEM client displays a warning on the Alerts Overview
page, and optionally sends a notification to a monitoring user.
The table below lists the system-defined alert templates that you can use to create an alert; please note that this list is subject to change, and may vary by system.
Within the table, the alerts are sorted by the target of the alert. The Template Name
and Description
columns identify and describe the behavior of the template. If the template Details
column specifies Yes
, metrics returned by the alert and alert parameters (if applicable) are accessible in the Alerts table
on the Global Overview
or Alerts
dashboards. If the Autocreated
column specifies Yes
, it is the predefined alert and enabled by default:
Templates applicable on Agent
Template Name | Description | Details | Autocreated |
---|---|---|---|
Load Average (1 minute) | 1-minute system load average. | ||
Load Average (5 minutes) | 5-minute system load average. | ||
Load Average (15 minutes) | 15-minute system load average. | ||
Load Average per CPU Core (1 minutes) | 1-minute system load average per CPU core. | ||
Load Average per CPU Core (5 minutes) | 5-minute system load average per CPU core. | Yes | |
Load Average per CPU Core (15 minutes) | 15-minute system load average per CPU core. | ||
CPU utilization | Average CPU consumption. | Yes | |
Number of CPUs running higher than a threshold | Number of CPUs running at greater than K% utilization. | Yes | |
Free memory percentage | Free memory as a percent of total system memory. | ||
Memory used percentage | Percentage of memory used. | Yes | |
Swap consumption | Swap space consumed (in megabytes). | ||
Swap consumption percentage | Percentage of swap area consumed. | Yes | |
Disk Consumption | Disk space consumed (in megabytes). | ||
Disk consumption percentage | Percentage of disk consumed. | ||
Disk Available | Disk space available (in megabytes). | ||
Disk busy percentage | Percentage of disk busy. | ||
Most used disk percentage | Percentage used of the most utilized disk on the system. | Yes | Yes |
Total table bloat on host | The total space wasted by tables on a host, in MB. | ||
Highest table bloat on host | The most space wasted by a table on a host, in MB. | ||
Average table bloat on host | The average space wasted by tables on host, in MB. | ||
Table size on host | The size of tables on host, in MB. | ||
Database size on host | The size of databases on host, in MB. | ||
Number of ERRORS in the logfile on agent N in last X hours | The number of ERRORS in the logfile on agent N in last X hours. | ||
Number of WARNINGS in the logfile on agent N in last X hours | The number of WARNINGS in the logfile on agent N in last X hours. | ||
Number of WARNINGS or ERRORS in the logfile on agent N in last X hours | The number of WARNINGS or ERRORS in the logfile on agent N in last X hours. | ||
Package version mismatch | Check for package version mismatch as per catalog. | Yes | |
Total materialized view bloat on host | The total space wasted by materialized views on a host, in MB. | ||
Highest materialized view bloat on host | The most space wasted by a materialized view on a host, in MB. | ||
Average materialized view bloat on host | The average space wasted by materialized views on host, in MB. | ||
Materialized view size on host | The size of materialized views on host, in MB. | ||
Agent Down | Specified agent is currently down. | Yes |
Templates applicable on Server
Template Name | Description | Details | Autocreated |
---|---|---|---|
Total table bloat in server | The total space wasted by tables in server, in MB. | ||
Largest table (by multiple of unbloated size) | Largest table in server, calculated as a multiple of its own estimated unbloated size; exclude tables smaller than N MB. | ||
Highest table bloat in server | The most space wasted by a table in server, in MB. | Yes | |
Average table bloat in server | The average space wasted by tables in server, in MB. | ||
Table size in server | The size of tables in server, in MB. | Yes | |
Database size in server | The size of databases in server, in MB. | Yes | |
Number of WAL files | Total number of Write Ahead Log files. | Yes | |
Number of prepared transactions | Number of transactions in prepared state. | Yes | |
Total connections | Total number of connections in the server. | Yes | Yes |
Total connections as percentage of max_connections | Total number of connections in the server as a percentage of maximum connections allowed on server, settings. | Yes | |
Unused, non-superuser connections | Number of unused, non-superuser connections on the server, user_info, settings. | ||
Unused, non-superuser connections as percentage of max_connections | Number of unused, non-superuser connections on the server as a percentage of max_connections, user_info, settings. | ||
Ungranted locks | Number of ungranted locks in server. | ||
Percentage of buffers written by backends | The percentage of buffers written by backends vs. the total buffers written. | ||
Percentage of buffers written by checkpoint | The percentage of buffers written by the checkpoints vs. the total buffers written. | ||
Buffers written per second | Number of buffers written per second, over the last two probe cycles. | ||
Buffers allocated per second | Number of buffers allocated per second, over the last two probe cycles. | ||
Connections in idle state | Number of connections in server that are in idle state. | Yes | Yes |
Connections in idle-in-transaction state | Number of connections in server that are in idle-in-transaction state. | Yes | Yes |
Connections in idle-in-transaction state,as percentage of max_connections | Number of connections in server that are in idle-in-transaction state, as a percentage of maximum connections allowed on server, settings | Yes | |
Long-running idle connections | Number of connections in the server that have been idle for more than N seconds. | Yes | |
Long-running idle connections and idle transactions | Number of connections in the server that have been idle or idle-in-transaction for more than N seconds. | Yes | |
Long-running idle transactions | Number of connections in the server that have been idle in transaction for more than N seconds. | Yes | |
Long-running transactions | Number of transactions in server that have been running for more than N seconds. | Yes | |
Long-running queries | Number of queries in server that have been running for more than N seconds. It does not include the long running vacuum or auto vacuum queries. | Yes | |
Long-running vacuums | Number of vacuum operations in server that have been running for more than N seconds. | Yes | |
Long-running autovacuums | Number of autovacuum operations in server that have been running for more than N seconds. | Yes | |
Committed transactions percentage | Percentage of transactions in the server that committed vs. that rolled-back over last N minutes. | ||
Shared buffers hit percentage | Percentage of block read requests in the server that were satisfied by shared buffers, over last N minutes. | ||
Tuples inserted | Tuples inserted into server over last N minutes. | ||
InfiniteCache buffers hit percentage | Percentage of block read requests in the server that were satisfied by InfiniteCache, over last N minutes. | ||
Tuples fetched | Tuples fetched from server over last N minutes. | ||
Tuples returned | Tuples returned from server over last N minutes. | ||
Dead Tuples | Number of estimated dead tuples in server. | ||
Tuples updated | Tuples updated in server over last N minutes. | ||
Tuples deleted | Tuples deleted from server over last N minutes. | ||
Tuples hot updated | Tuples hot updated in server, over last N minutes. | ||
Sequential Scans | Number of full table scans in server, over last N minutes. | ||
Index Scans | Number of index scans in server, over last N minutes. | ||
Hot update percentage | Percentage of hot updates in the server over last N minutes. | ||
Live Tuples | Number of estimated live tuples in server. | ||
Dead tuples percentage | Percentage of estimated dead tuples in server. | ||
Last Vacuum | Hours since last vacuum on the server. | Yes | |
Last AutoVacuum | Hours since last autovacuum on the server. | Yes | |
Last Analyze | Hours since last analyze on the server. | ||
Last AutoAnalyze | Hours since last autoanalyze on the server. | ||
Percentage of buffers written by backends over last N minutes | The percentage of buffers written by backends vs. the total buffers written over last N minutes. | ||
Table Count | Total number of tables in server. | ||
Function Count | Total number of functions in server. | ||
Sequence Count | Total number of sequences in server. | ||
A user expires in N days | Number of days before a user's validity expires. | ||
Index size as a percentage of table size | Size of the indexes in server, as a percentage of their tables' size. | ||
Largest index by table-size percentage | Largest index in server, calculated as percentage of its table's size, oc_index, table_size. | Yes | |
Number of ERRORS in the logfile on server M in the last X hours | The number of ERRORS in the logfile on server M in last X hours. | ||
Number of WARNINGS in the logfile on server M in the last X hours | The number of WARNINGS in logfile on server M in the last X hours. | ||
Number of WARNINGS or ERRORS in the logfile on server M in the last X hours | The number of WARNINGS or ERRORS in the logfile on server M in the last X hours. | ||
Number of attacks detected in the last N minutes | The number of SQL injection attacks occurred in the last N minutes. | ||
Number of attacks detected in the last N minutes by username | The number of SQL injection attacks occurred in the last N minutes by username. | ||
Number of replica servers lag behind the primary by write location | Streaming Replication: number of replica servers lag behind the primary by write location. | Yes | |
Number of replica servers lag behind the primary by flush location | Streaming Replication: number of replica servers lag behind the primary by flush location. | Yes | |
Number of replica servers lag behind the primary by replay location | Streaming Replication: number of replica servers lag behind the primary by replay location. | Yes | |
Replica server lag behind the primary by write location | Streaming Replication: replica server lag behind the primary by write location in MB. | Yes | |
Replica server lag behind the primary by flush location | Streaming Replication: replica server lag behind the primary by flush location in MB. | Yes | |
Replica server lag behind the primary by WAL pages | Streaming Replication: replica server lag behind the primary by WAL pages. | ||
Replica server lag behind the primary by WAL segments | Streaming Replication: replica server lag behind the primary by WAL segments. | ||
Replica server lag behind the primary by replay location | Streaming Replication: replica server lag behind the primary by replay location in MB. | Yes | |
Replica server lag behind the primary by size (MB) | Streaming Replication: replica server lag behind the primary by size in MB. | Yes | |
Total materialized view bloat in server | The total space wasted by materialized views in server, in MB. | ||
Largest materialized view (by multiple of unbloated size) | Largest materialized view in server, calculated as a multiple of its own estimated unbloated size; exclude materialized views smaller than N MB. | ||
Highest materialized view bloat in server | The most space wasted by a materialized view in server, in MB. | ||
Average materialized view bloat in server | The average space wasted by materialized views in server, in MB. | ||
Materialized view size in server | The size of materialized view in server, in MB. | ||
View Count | Total number of views in server. | ||
Materialized View Count | Total number of materialized views in server. | ||
Audit config mismatch | Check for audit config parameter mismatch | Yes | Yes |
Server Down | Specified server is currently inaccessible. | Yes | |
Number of WAL archives pending | Streaming Replication: number of WAL files pending to be replayed at replica. | ||
Number of minutes lag of replica server from primary server | Streaming Replication: number of minutes replica node is lagging behind the primary node. | ||
Log config mismatch | Check for log config parameter mismatch. | Yes | Yes |
PGD Group Raft Consensus | PGD group raft consensus not working | Yes | Yes |
PGD Group Raft Leader ID not matching | PGD group raft leader id not matching | Yes | Yes |
PGD Group Versions check | PGD/pglogical version mismatched in PGD group | Yes | Yes |
PGD worker error detected | PGD worker error detected reported for PGD node | Yes | |
Transaction ID exhaustion (wraparound) | Check for Transaction ID exhaustion (wraparound). | Yes | Yes |
Templates applicable on Database
Template Name | Description | Details | Autocreated |
---|---|---|---|
Total table bloat in database | The total space wasted by tables in database, in MB. | ||
Largest table (by multiple of unbloated size) | Largest table in database, calculated as a multiple of its own estimated unbloated size; exclude tables smaller than N MB. | ||
Highest table bloat in database | The most space wasted by a table in database, in MB. | ||
Average table bloat in database | The average space wasted by tables in database, in MB. | ||
Table size in database | The size of tables in database, in MB. | Yes | |
Database size | The size of the database, in MB. | ||
Total connections | Total number of connections in the database. | Yes | |
Total connections as percentage of max_connections | Total number of connections in the database as a percentage of maximum connections allowed on server, settings. | ||
Ungranted locks | Number of ungranted locks in database. | ||
Connections in idle state | Number of connections in database that are in idle state. | Yes | |
Connections in idle-in-transaction state | Number of connections in database that are in idle-in-transaction state. | Yes | |
Connections in idle-in-transaction state,as percentage of max_connections | Number of connections in database that are in idle-in-transaction state, as a percentage of maximum connections allowed on server, settings. | ||
Long-running idle connections | Number of connections in the database that have been idle for more than N seconds. | Yes | |
Long-running idle connections and idle transactions | Number of connections in the database that have been idle or idle-in-transaction for more than N seconds. | Yes | |
Long-running idle transactions | Number of connections in the database that have been idle in transaction for more than N seconds. | Yes | |
Long-running transactions | Number of transactions in database that have been running for more than N seconds. | Yes | |
Long-running queries | Number of queries in database that have been running for more than N seconds. It does not include the long running vacuum or auto vacuum queries. | Yes | |
Long-running vacuums | Number of vacuum operations in database that have been running for more than N seconds. | Yes | |
Long-running autovacuums | Number of autovacuum operations in database that have been running for more than N seconds. | Yes | |
Committed transactions percentage | Percentage of transactions in the database that committed vs. that rolled-back over last N minutes. | ||
Shared buffers hit percentage | Percentage of block read requests in the database that were satisfied by shared buffers, over last N minutes. | ||
InfiniteCache buffers hit percentage | Percentage of block read requests in the database that were satisfied by InfiniteCache, over last N minutes. | ||
Tuples fetched | Tuples fetched from database over last N minutes. | ||
Tuples returned | Tuples returned from database over last N minutes. | ||
Tuples inserted | Tuples inserted into database over last N minutes. | ||
Tuples updated | Tuples updated in database over last N minutes. | ||
Tuples deleted | Tuples deleted from database over last N minutes. | ||
Tuples hot updated | Tuples hot updated in database, over last N minutes. | ||
Sequential Scans | Number of full table scans in database, over last N minutes. | ||
Index Scans | Number of index scans in database, over last N minutes. | ||
Hot update percentage | Percentage of hot updates in the database over last N minutes. | ||
Live Tuples | Number of estimated live tuples in database. | ||
Dead Tuples | Number of estimated dead tuples in database. | ||
Dead tuples percentage | Percentage of estimated dead tuples in database. | ||
Last Vacuum | Hours since last vacuum on the database. | ||
Last AutoVacuum | Hours since last autovacuum on the database. | ||
Last Analyze | Hours since last analyze on the database. | ||
Last AutoAnalyze | Hours since last autoanalyze on the database. | ||
Table Count | Total number of tables in database. | ||
Function Count | Total number of functions in database. | ||
Sequence Count | Total number of sequences in database. | ||
Index size as a percentage of table size | Size of the indexes in database, as a percentage of their tables' size. | ||
Largest index by table-size percentage | Largest index in database, calculated as percentage of its table's size, oc_index, table_size | ||
Database Frozen XID | The age (in transactions before the current transaction) of the database's frozen transaction ID. | ||
Number of attacks detected in the last N minutes | The number of SQL injection attacks occurred in the last N minutes. | ||
Number of attacks detected in the last N minutes by username | The number of SQL injection attacks occurred in the last N minutes by username. | ||
Queries that have been cancelled due to dropped tablespaces | Streaming Replication: number of queries that have been cancelled due to dropped tablespaces. | ||
Queries that have been cancelled due to lock timeouts | Streaming Replication: number of queries that have been cancelled due to lock timeouts. | ||
Queries that have been cancelled due to old snapshots | Streaming Replication: number of queries that have been cancelled due to old snapshots. | ||
Queries that have been cancelled due to pinned buffers | Streaming Replication: number of queries that have been cancelled due to pinned buffers. | ||
Queries that have been cancelled due to deadlocks | Streaming Replication: number of queries that have been cancelled due to deadlocks. | ||
Total events lagging in all slony clusters | Slony Replication: total events lagging in all slony clusters. | Yes | |
Events lagging in one slony cluster | Slony Replication: events lagging in one slony cluster. | ||
Lag time (minutes) in one slony cluster | Slony Replication: lag time (minutes) in one slony cluster. | ||
Total rows lagging in xdb single primary replication | xDB Replication: Total rows lagging in xdb single primary replication | Yes | |
Total rows lagging in xdb multi primary replication | xDB Replication: Total rows lagging in xdb multi primary replication | Yes | |
Total materialized view bloat in database | The total space wasted by materialized views in database, in MB. | ||
Largest materialized view (by multiple of unbloated size) | Largest materialized view in database, calculated as a multiple of its own estimated unbloated size; exclude materialized views smaller than N MB. | ||
Highest materialized view bloat in database | The most space wasted by a materialized view in database, in MB. | ||
Average materialized view bloat in database | The average space wasted by materialized views in database, in MB. | ||
Materialized view size in database | The size of materialized view in database, in MB. | ||
View Count | Total number of views in database. | ||
Materialized View Count | Total number of materialized views in database. |
Templates applicable on Schema
Template Name | Description | Details | Autocreated |
---|---|---|---|
Total table bloat in schema | The total space wasted by tables in schema, in MB. | Yes | |
Largest table (by multiple of unbloated size) | Largest table in schema, calculated as a multiple of its own estimated unbloated size; exclude tables smaller than N MB. | ||
Highest table bloat in schema | The most space wasted by a table in schema, in MB. | ||
Average table bloat in schema | The average space wasted by tables in schema, in MB. | ||
Table size in schema | The size of tables in schema, in MB. | Yes | |
Tuples inserted | Tuples inserted in schema over last N minutes. | ||
Tuples updated | Tuples updated in schema over last N minutes. | ||
Tuples deleted | Tuples deleted from schema over last N minutes. | ||
Tuples hot updated | Tuples hot updated in schema, over last N minutes. | ||
Sequential Scans | Number of full table scans in schema, over last N minutes. | ||
Index Scans | Number of index scans in schema, over last N minutes. | ||
Hot update percentage | Percentage of hot updates in the schema over last N minutes. | ||
Live Tuples | Number of estimated live tuples in schema. | ||
Dead Tuples | Number of estimated dead tuples in schema. | ||
Dead tuples percentage | Percentage of estimated dead tuples in schema. | ||
Last Vacuum | Hours since last vacuum on the schema. | ||
Last AutoVacuum | Hours since last autovacuum on the schema. | ||
Last Analyze | Hours since last analyze on the schema. | ||
Last AutoAnalyze | Hours since last autoanalyze on the schema. | ||
Table Count | Total number of tables in schema. | ||
Function Count | Total number of functions in schema. | ||
Sequence Count | Total number of sequences in schema. | ||
Index size as a percentage of table size | Size of the indexes in schema, as a percentage of their table's size. | ||
Largest index by table-size percentage | Largest index in schema, calculated as percentage of its table's size, oc_index, table_size | ||
Materialized View bloat | Space wasted by the materialized view, in MB. | ||
Total materialized view bloat in schema | The total space wasted by materialized views in schema, in MB. | ||
Materialized view size as a multiple of ubloated size | Size of the materialized view as a multiple of estimated unbloated size. | ||
Largest materialized view (by multiple of unbloated size) | Largest materialized view in schema, calculated as a multiple of its own estimated unbloated size; exclude materialized view smaller than N MB. | ||
Highest materialized view bloat in schema | The most space wasted by a materialized view in schema, in MB. | ||
Average materialized view bloat in schema | The average space wasted by materialized views in schema, in MB. | ||
Materialized view size | The size of materialized view, in MB. | ||
Materialized view size in schema | The size of materialized views in schema, in MB. | ||
View Count | Total number of views in schema. | ||
Materialized View Count | Total number of materialized views in schema. | ||
Materialized View Frozen XID | The age (in transactions before the current transaction) of the materialized view's frozen transaction ID. |
Templates applicable on Table
Template Name | Description | Details | Autocreated |
---|---|---|---|
Table bloat | Space wasted by the table, in MB. | ||
Table size | The size of table, in MB. | ||
Table size as a multiple of ubloated size | Size of the table as a multiple of estimated unbloated size. | ||
Tuples inserted | Tuples inserted in table over last N minutes. | ||
Tuples updated | Tuples updated in table over last N minutes. | ||
Tuples deleted | Tuples deleted from table over last N minutes. | ||
Tuples hot updated | Tuples hot updated in table, over last N minutes. | ||
Sequential Scans | Number of full table scans on table, over last N minutes. | ||
Index Scans | Number of index scans on table, over last N minutes. | ||
Hot update percentage | Percentage of hot updates in the table over last N minutes. | ||
Live Tuples | Number of estimated live tuples in table. | ||
Dead Tuples | Number of estimated dead tuples in table. | ||
Dead tuples percentage | Percentage of estimated dead tuples in table. | ||
Last Vacuum | Hours since last vacuum on the table. | ||
Last AutoVacuum | Hours since last autovacuum on the table. | ||
Last Analyze | Hours since last analyze on the table. | ||
Last AutoAnalyze | Hours since last autoanalyze on the table. | ||
Row Count | Estimated number of rows in a table. | ||
Index size as a percentage of table size | Size of the indexes on table, as a percentage of table's size. | ||
Table Frozen XID | The age (in transactions before the current transaction) of the table's frozen transaction ID. |
Global Templates
Template Name | Description | Details | Autocreated |
---|---|---|---|
Agents Down | Number of agents that haven't reported in recently. | ||
Servers Down | Number of servers that are currently inaccessible. | ||
Alert Errors | Number of alerts in an error state. |