Predefined alert templates - reference v10.3

An alert definition contains a system-defined or user-defined set of conditions that PEM compares to the system statistics. If the statistics deviate from the boundaries specified for that statistic, the alert triggers, and the PEM client displays a warning on the Alerts Overview page and optionally sends a notification to a monitoring user.

The tables that follow list the system-defined alert templates that you can use to create an alert. This list is subject to change and can vary by system.

Templates applicable on agent

Template nameDescriptionProbe dependency
Load Average (1 minute)1-minute system load averageload_average
Load Average (5 minutes)5-minute system load averageload_average
Load Average (15 minutes)15-minute system load averageload_average
Load Average per CPU Core (1 minutes)1-minute system load average per CPU coreload_average
Load Average per CPU Core (5 minutes)5-minute system load average per CPU coreload_average
Load Average per CPU Core (15 minutes)15-minute system load average per CPU coreload_average
CPU utilizationAverage CPU consumptioncpu_usage
Number of CPUs running higher than aNumber of CPUs running at greater than K% utilization thresholdcpu_usage
Free memory percentageFree memory as a percent of total system memorymemory_usage
Memory used percentagePercentage of memory usedmemory_usage
Swap consumptionSwap space consumed (in megabytes)memory_usage
Swap consumption percentagePercentage of swap area consumedmemory_usage
Disk ConsumptionDisk space consumed (in megabytes)disk_space
Disk consumption percentagePercentage of disk consumeddisk_space
Disk AvailableDisk space available (in megabytes)disk_space
Disk busy percentagePercentage of disk busydisk_busy_info
Most used disk percentagePercentage used of the most utilized disk on the systemdisk_space
Total table bloat on hostThe total space wasted by tables on a host, in MBtable_bloat, settings
Highest table bloat on hostThe most space wasted by a table on a host, in MBtable_bloat, settings
Average table bloat on hostThe average space wasted by tables on host, in MBtable_bloat, settings
Table size on hostThe size of tables on host, in MBtable_size
Database size on hostThe size of databases on host, in MBdatabase_size
Number of ERRORS in the logfile on agent N in last X hours.The number of ERRORS in the logfile on agent N in last X hoursN/A
Number of ERRORS in the audit logfile on agent N in last X hoursThe number of ERRORS in the audit logfile on agent N in last X hoursN/A
Number of WARNINGS in the logfile on agent N in last X hoursThe number of WARNINGS in the logfile on agent N in last X hoursN/A
Number of WARNINGS in the audit logfile on agent N in last X hoursThe number of WARNINGS in the audit logfile on agent N in last X hoursN/A
Number of WARNINGS or ERRORS in the logfile on agent N in last X hoursThe number of WARNINGS or ERRORS in the logfile on agent N in last X hoursN/A
Number of WARNINGS or ERRORS in audit the logfile on agent N in last X hoursThe number of WARNINGS or ERRORS in the logfile on agent N in last X hoursN/A
Package version mismatchCheck for package version mismatch as per catalogN/A
Total materialized view bloat on hostThe total space wasted by materialized views on a host, in MBmview_bloat, settings
Highest materialized view bloat on hostThe most space wasted by a materialized view on a host, in MBmview_bloat, settings
Average materialized view bloat on hostThe average space wasted by materialized views on host, in MBmview_bloat, settings
Materialized view size on hostThe size of materialized views on host, in MBmview_size
Agent DownSpecified agent is currently downN/A

Templates applicable on server

Template nameDescriptionProbe dependency
Audit config mismatchCheck for audit config parameter mismatchaudit_configuration
Average materialized view bloat in serverThe average space wasted by materialized views in server, in MBmview_bloat, settings
Average table bloat in serverThe average space wasted by tables in server, in MBtable_bloat, settings
Buffers allocated per secondNumber of buffers allocated per second, over the last two probe cyclesbackground_writer_statistics
Buffers written per secondNumber of buffers written per second, over the last two probe cyclesbackground_writer_statistics
Committed transactions percentagePercentage of transactions in the server that committed vs. that rolled-back over last N minutesdatabase_statistics
Conflicting replication slotsCheck for slots that are conflicting for a particular server
Connections in idle stateNumber of connections in server that are in idle statesession_info
Connections in idle-in-transaction stateNumber of connections in server that are in idle-in-transaction statesession_info
Connections in idle-in-transaction state, as percentage of max_connectionsNumber of connections in server that are in idle-in-transaction state, as a percentage of maximum connections allowed on server, settingssession_info, settings
Database size in serverThe size of databases in server, in MBdatabase_size
Dead TuplesNumber of estimated dead tuples in servertable_statistics
Dead tuples percentagePercentage of estimated dead tuples in servertable_statistics
EFM agent downFailover Manager service is downefm_cluster_info
EFM cluster failover detectedFailover is triggered when a failover event is recorded for an EFM cluster within the specified time.failover_manager_node_status
EFM fewer than N nodes activeTriggers when the number of active EFM nodes in a cluster falls below the expected thresholdefm_cluster_node_status
EFM missing primaryEFM cluster is missing the primary nodeefm_cluster_node_status
Function CountTotal number of functions in serveroc_function
Highest materialized view bloat in serverThe most space wasted by a materialized view in server, in MBmview_bloat, settings
Highest table bloat in serverThe most space wasted by a table in server, in MBtable_bloat, settings
Hot update percentagePercentage of hot updates in the server over last N minutestable_statistics
Inactive replication slotsCheck for slots that are inactive for a particular server
Index ScansNumber of index scans in server, over last N minutestable_statistics
Index size as a percentage of table sizeSize of the indexes in server, as a percentage of their tables' sizeindex_size, oc_index, table_size
InfiniteCache buffers hit percentagePercentage of block read requests in the server that were satisfied by InfiniteCache, over last N minutesdatabase_statistics
Largest index by table-size percentageLargest index in server, calculated as percentage of its table's size, oc_index, table_sizeindex_size, oc_index, table_size
Largest materialized view (by multiple of unbloated size)Largest materialized view in server, calculated as a multiple of its own estimated unbloated size; exclude materialized views smaller than N MBmview_bloat, settings
Largest table (by multiple of unbloated size)Largest table in server, calculated as a multiple of its own estimated unbloated size; exclude tables smaller than N MBtable_bloat, settings
Last AnalyzeHours since last analyze on the servertable_statistics
Last AutoAnalyzeHours since last autoanalyze on the servertable_statistics
Last AutoVacuumHours since last autovacuum on the servertable_statistics
Last VacuumHours since last vacuum on the servertable_statistics
Live TuplesNumber of estimated live tuples in servertable_statistics
Log config mismatchCheck for log config parameter mismatchlog_configuration
Long-running autovacuumsNumber of autovacuum operations in server that have been running for more than N secondssession_info
Long-running idle connectionsNumber of connections in the server that have been idle for more than N secondssession_info
Long-running idle connections and idle transactionsNumber of connections in the server that have been idle or transactions idle-in-transaction for more than N secondssession_info
Long-running idle transactionsNumber of connections in the server that have been idle in transaction for more than N secondssession_info
Long-running queriesNumber of queries in server that have been running for more than N secondssession_info
Long-running transactionsNumber of transactions in server that have been running for more than N secondssession_info
Long-running vacuumsNumber of vacuum operations in server that have been running for more than N secondssession_info
Materialized View CountTotal number of materialized views in serveroc_views
Materialized view size in serverThe size of materialized view in server, in MBmview_size
Multixact ID exhaustion (wraparound)Check for multixact ID exhaustion (wraparound)
Number of attacks detected in the last N minutesThe number of SQL injection attacks occurred in the last N minutessql_protect
Number of attacks detected in the last N minutes by usernameThe number of SQL injection attacks occurred in the last N minutes by usernamesql_protect
Number of ERRORS in the logfile on server M in the last X hoursThe number of ERRORS in the logfile on server M in last X hoursN/A
Number of minutes lag of replica server from primary serverStreaming Replication: number of minutes replica node is lagging behind the primary nodestreaming_replication_lag_time
Number of prepared transactionsNumber of transactions in prepared statenumber_of_prepared_transactions
Number of replica servers lag behind the primary by flush locationStreaming Replication: number of replica servers lag behind the primary by flush locationstreaming_replication
Number of replica servers lag behind the primary by replay locationStreaming Replication: number of replica servers lag behind the primary by replay locationstreaming_replication
Number of replica servers lag behind the primary by write locationStreaming Replication: number of replica servers lag behind the primary by write locationstreaming_replication
Number of users expiring in N daysNumber of users whose accounts are expiring in N daysuser_info
Number of users whose password expiring in N daysNumber of users whose password have expired or are expiring in N daysuser_info
Number of WAL archives pendingStreaming Replication: number of WAL files pending to be replayed at replicawal_archive_status
Number of WAL filesTotal number of Write Ahead Log filesnumber_of_wal_files
Number of WARNINGS in the logfile on server M in the last X hoursThe number of WARNINGS in logfile on server M in the last X hoursN/A
Number of WARNINGS or ERRORS in the logfile on server M in the last X hoursThe number of WARNINGS or ERRORS in the logfile on server M in the last X hoursN/A
Patroni cluster pausedPatroni: Detects if the Patroni cluster is paused and unavailable for failover.patroni_cluster_status
Patroni cluster failover detectedPatroni: Failover is triggered when a failover event is recorded for a Patroni cluster within the specified time.patroni_node_status
Patroni DCS not healthyPatroni: Detects if the distributed configuration store (etcd) is not healthy.patroni_cluster_status
Patroni down or out of contactPatroni: Detects if the Patroni process is not reachable or has failed on a monitored node.patroni_cluster_status
Patroni no leader detectedPatroni: Detects when Patroni cluster has no leader/master node.patroni_cluster_status
Patroni timeline mismatchPatroni: Detects if the node timeline doesn't match the cluster timeline.patroni_node_status, patroni_cluster_status
Percentage of buffers written by backendsThe percentage of buffers written by backends vs. the total buffers writtenbackground_writer_statistics
Percentage of buffers written by backends over the last N minutesThe percentage of buffers written by backends vs. the total buffers backends over last Nbackground_writer_statistics
Percentage of buffers written by checkpointThe percentage of buffers written by the checkpoints vs. the total buffers writtenbackground_writer_statistics
PGD Group Raft ConsensusPGD group Raft consensus not workingbdr_monitor_group_raft
PGD Group Raft Leader ID not matchingPGD group Raft leader ID not matchingbdr_group_raft_details
PGD Group versions checkPGD/pglogical version mismatched in PGD groupbdr_monitor_group_raft
PGD worker error detectedPGD worker error detected reported for PGD node
Replica server lag behind the primary by flush locationStreaming Replication: replica server lag behind the primary by flush location in MBstreaming_replication
Replica server lag behind the primary by replay locationStreaming Replication: replica server lag behind the primary by replay location in MBstreaming_replication
Replica server lag behind the primary by size (MB)Streaming Replication: replica server lag behind the primary by size in MBstreaming_replication
Replica server lag behind the primary by WAL pagesStreaming Replication: replica server lag behind the primary by WAL pagesstreaming_replication
Replica server lag behind the primary by WAL segmentsStreaming Replication: replica server lag behind the primary by WAL segmentsstreaming_replication
Replica server lag behind the primary by write locationStreaming Replication: replica server lag behind the primary by write location in MBstreaming_replication
Sequence CountTotal number of sequences in serveroc_sequence
Sequential ScansNumber of full table scans in server, over last N minutestable_statistics
Server DownSpecified server is currently inaccessibleN/A
Shared buffers hit percentagePercentage of block read requests in the server that were satisfied by shared buffers, over last N minutesdatabase_statistics
Table CountTotal number of tables in serveroc_table
Table size in serverThe size of tables in server, in MBtable_size
Total connectionsTotal number of connections in the serversession_info
Total connections as percentage of max_connectionsTotal number of connections in the server as a percentage of maximum connections allowed on server, settingssession_info, settings
Total materialized view bloat in serverThe total space wasted by materialized views in server, in MBmview_bloat, settings
Total table bloat in serverThe total space wasted by tables in server, in MBtable_bloat, settings
Transaction ID exhaustion (wraparound)Check for transaction ID exhaustion (wraparound)
Tuples deletedTuples deleted from server over last N minutesdatabase_statistics
Tuples fetchedTuples fetched from server over last N minutesdatabase_statistics
Tuples hot updatedTuples hot updated in server, over last N minutestable_statistics
Tuples insertedTuples inserted into server over last N minutesdatabase_statistics
Tuples returnedTuples returned from server over last N minutesdatabase_statistics
Tuples updatedTuples updated in server over last N minutesdatabase_statistics
Ungranted locksNumber of ungranted locks in serverblocked_session_info
Unused, non-superuser connectionsNumber of unused, non-superuser connections on the server, user_info, settingssession_info, user_info, settings
Unused, non-superuser connections as percentage of max_connectionsNumber of unused, non-superuser connections on the server as a percentage of max_connections of max_connections, user_info, settingssession_info, user_info, settings
View CountTotal number of views in serveroc_views

Templates applicable on database

Template nameDescriptionProbe dependency
Total table bloat in databaseThe total space wasted by tables in database, in MBtable_bloat, settings
Largest table (by multiple of unbloated size)Largest table in database, calculated as a multiple of its own estimated unbloated size; exclude tables smaller than N MBtable_bloat, settings
Highest table bloat in databaseThe most space wasted by a table in database, in MBtable_bloat, settings
Average table bloat in databaseThe average space wasted by tables in database, in MBtable_bloat, settings
Table size in databaseThe size of tables in database, in MBtable_size
Database sizeThe size of the database, in MBdatabase_size
Total connectionsTotal number of connections in the databasesession_info
Total connections as percentage of max_connectionsTotal number of connections in the database as a percentage of maximum connections allowed on server, settingssession_info, settings
Ungranted locksNumber of ungranted locks in databaseblocked_session_info
Connections in idle stateNumber of connections in database that are in idle statesession_info
Connections in idle-in-transaction stateNumber of connections in database that are in idle-in-transaction statesession_info
Connections in idle-in-transaction state,as percentage of max_connectionsNumber of connections in database that are in idle-in-transaction state, as a percentage of maximum connections allowed on server, settingssession_info, settings
Long-running idle connectionsNumber of connections in the database that have been idle for more than N secondssession_info
Long-running idle connections and idle transactionsNumber of connections in the database that have been idle or idle-in-transaction for more than N secondssession_info
Long-running idle transactionsNumber of connections in the database that have been idle in transaction for more than N secondssession_info
Long-running transactionsNumber of transactions in database that have been running for more than N secondssession_info
Long-running queriesNumber of queries in database that have been running for more than N secondssession_info
Long-running vacuumsNumber of vacuum operations in database that have been running for more than N secondssession_info
Long-running autovacuumsNumber of autovacuum operations in database that have been running for more than N secondssession_info
Committed transactions percentagePercentage of transactions in the database that committed vs. that rolled-back over last N minutesdatabase_statistics
Shared buffers hit percentagePercentage of block read requests in the database that were satisfied by shared buffers, over last N minutesdatabase_statistics
InfiniteCache buffers hit percentagePercentage of block read requests in the database that were satisfied by InfiniteCache, over last N minutesdatabase_statistics
Tuples fetchedTuples fetched from database over last N minutesdatabase_statistics
Tuples returnedTuples returned from database over last N minutesdatabase_statistics
Tuples insertedTuples inserted into database over last N minutesdatabase_statistics
Tuples updatedTuples updated in database over last N minutesdatabase_statistics
Tuples deletedTuples deleted from database over last N minutesdatabase_statistics
Tuples hot updatedTuples hot updated in database, over last N minutestable_statistics
Sequential ScansNumber of full table scans in database, over last N minutestable_statistics
Index ScansNumber of index scans in database, over last N minutestable_statistics
Hot update percentagePercentage of hot updates in the database over last N minutestable_statistics
Live TuplesNumber of estimated live tuples in databasetable_statistics
Dead TuplesNumber of estimated dead tuples in databasetable_statistics
Dead tuples percentagePercentage of estimated dead tuples in databasetable_statistics
Last VacuumHours since last vacuum on the databasetable_statistics
Last AutoVacuumHours since last autovacuum on the databasetable_statistics
Last AnalyzeHours since last analyze on the databasetable_statistics
Last AutoAnalyzeHours since last autoanalyze on the databasetable_statistics
Table CountTotal number of tables in databaseoc_table
Function CountTotal number of functions in databaseoc_function
Sequence CountTotal number of sequences in databaseoc_sequence
Index size as a percentage of table sizeSize of the indexes in database, as a percentage of their tables' sizetable_size
Largest index by table-size percentageLargest index in database, calculated as percentage of its table's size, oc_index, table_sizeindex_size, oc_index, table_size
Database Frozen XIDThe age (in transactions before the current transaction) of the database's frozen transaction IDdatabase_frozenxid
Number of attacks detected in the last N minutesThe number of SQL injection attacks occurred in the last N minutessql_protect
Number of attacks detected in the last N minutes by usernameThe number of SQL injection attacks occurred in the last N minutes by last N minutes by usernamesql_protect
Queries that have been cancelled due to dropped tablespacesStreaming Replication: number of queries that have been cancelled due to dropped tablespacesstreaming_replication_db_conflicts
Queries that have been cancelled due to lock timeoutsStreaming Replication: number of queries that have been cancelled due to lock timeoutsstreaming_replication_db_conflicts
Queries that have been cancelled due to old snapshotsStreaming Replication: number of queries that have been cancelled due to old snapshotsstreaming_replication_db_conflicts
Queries that have been cancelled due to pinned buffersStreaming Replication: number of queries that have been cancelled due to pinned buffersstreaming_replication_db_conflicts
Queries that have been cancelled due to deadlocksStreaming Replication: number of queries that have been cancelled due to deadlocksstreaming_replication_db_conflicts
Total events lagging in all slony clustersSlony Replication: total events lagging in all slony clustersslony_cluster
Events lagging in one slony clusterSlony Replication: events lagging in one slony clusterslony_cluster
Lag time (minutes) in one slony clusterSlony Replication: lag time (minutes) in one slony clusterslony_cluster
Total rows lagging in xdb single primary replicationxDB Replication: Total rows lagging in xdb single primary replicationxdb_smr_mmr_replication
Total rows lagging in xdb multi primary replicationxDB Replication: Total rows lagging in xdb multi primary replicationxdb_smr_mmr_replication
Total materialized view bloat in databaseThe total space wasted by materialized views in database, in MBmview_bloat, settings
Largest materialized view (by multiple of unbloated size)Largest materialized view in database, calculated as a multiple of its estimated unbloated size; exclude materialized views smaller than N MBmview_bloat, settings
Highest materialized view bloat in databaseThe most space wasted by a materialized view in database, in MBmview_bloat, settings
Average materialized view bloat in databaseThe average space wasted by materialized views in database, in MBmview_bloat, settings
Materialized view size in databaseThe size of materialized view in database, in MBmview_size
View CountTotal number of views in databaseoc_views
Materialized View CountTotal number of materialized views in databaseoc_views

Templates applicable on schema

Template nameDescriptionProbe dependency
Total table bloat in schemaThe total space wasted by tables in schema, in MBtable_bloat, settings
Largest table (by multiple of unbloated size)Largest table in schema, calculated as a multiple of its own estimated unbloated size; exclude tables smaller than N MBtable_bloat, settings
Highest table bloat in schemaThe most space wasted by a table in schema, in MBtable_bloat, settings
Average table bloat in schemaThe average space wasted by tables in schema, in MBtable_bloat, settings
Table size in schemaThe size of tables in schema, in MBtable_size
Tuples insertedTuples inserted in schema over last N minutestable_statistics
Tuples updatedTuples updated in schema over last N minutestable_statistics
Tuples deletedTuples deleted from schema over last N minutestable_statistics
Tuples hot updatedTuples hot updated in schema, over last N minutestable_statistics
Sequential ScansNumber of full table scans in schema, over last N minutestable_statistics
Index ScansNumber of index scans in schema, over last N minutestable_statistics
Hot update percentagePercentage of hot updates in the schema over last N minutestable_statistics
Live TuplesNumber of estimated live tuples in schematable_statistics
Dead TuplesNumber of estimated dead tuples in schematable_statistics
Dead tuples percentagePercentage of estimated dead tuples in schematable_statistics
Last VacuumHours since last vacuum on the schematable_statistics
Last AutoVacuumHours since last autovacuum on the schematable_statistics
Last AnalyzeHours since last analyze on the schematable_statistics
Last AutoAnalyzeHours since last autoanalyze on the schematable_statistics
Table CountTotal number of tables in schemaoc_table
Function CountTotal number of functions in schemaoc_function
Sequence CountTotal number of sequences in schemaoc_sequence
Index size as a percentage of table sizeSize of the indexes in schema, as a percentage of their table's sizetable_size
Largest index by table-size percentageLargest index in schema, calculated as percentage of its table's size, oc_index, table_sizeindex_size, oc_index, table_size
Materialized view bloatSpace wasted by the materialized view, in MBmview_bloat, settings
Total materialized view bloat in schemaThe total space wasted by materialized views in schema, in MBmview_bloat, settings
Materialized view size as a multiple of unbloated sizeSize of the materialized view as a multiple of estimated unbloated sizemview_bloat
Largest materialized view (by multiple of unbloated size)Largest materialized view in schema, calculated as a multiple of its own estimated unbloated size; exclude materialized view smaller than N MBmview_bloat, settings
Highest materialized view bloat in schemaThe most space wasted by a materialized view in schema, in MBmview_bloat, settings
Average materialized view bloat in schemaThe average space wasted by materialized views in schema, in MBmview_bloat, settings
Materialized view sizeThe size of materialized view, in MBmview_size
Materialized view size in schemaThe size of materialized views in schema, in MBmview_size
View CountTotal number of views in schemaoc_views
Materialized View CountTotal number of materialized views in schemaov_views
Materialized View Frozen XIDThe age (in transactions before the current transaction) of the materialized view's frozen transaction IDmview_frozenxid

Templates applicable on table

Template nameDescriptionProbe dependency
Table bloatSpace wasted by the table, in MBtable_bloat, settings
Table sizeThe size of table, in MBtable_size
Table size as a multiple of unbloated sizeSize of the table as a multiple of estimated unbloated sizetable_bloat
Tuples insertedTuples inserted in table over last N minutestable_statistics
Tuples updatedTuples updated in table over last N minutestable_statistics
Tuples deletedTuples deleted from table over last N minutestable_statistics
Tuples hot updatedTuples hot updated in table, over last N minutestable_statistics
Sequential ScansNumber of full table scans on table, over last N minutestable_statistics
Index ScansNumber of index scans on table, over last N minutestable_statistics
Hot update percentagePercentage of hot updates in the table over last N minutestable_statistics
Live TuplesNumber of estimated live tuples in tabletable_statistics
Dead TuplesNumber of estimated dead tuples in tabletable_statistics
Dead tuples percentagePercentage of estimated dead tuples in tabletable_statistics
Last VacuumHours since last vacuum on the tabletable_statistics
Last AutoVacuumHours since last autovacuum on the tabletable_statistics
Last AnalyzeHours since last analyze on the tabletable_statistics
Last AutoAnalyzeHours since last autoanalyze on the tabletable_statistics
Row CountEstimated number of rows in a tabletable_statistics
Index size as a percentage of table sizeSize of the indexes on table, as a percentage of table's sizetable_size
Table Frozen XIDThe age (in transactions before the current transaction) of the table's frozen transaction IDtable_frozenxid

Global templates

Template nameDescriptionProbe dependency
Agents DownNumber of agents that haven't reported in recentlyN/A
Servers DownNumber of servers that are currently inaccessibleN/A
Alert ErrorsNumber of alerts in an error stateN/A