pgCluu :: pgCluu

Cluster
Sun Aug 21 11:02:24 2022 to Sun Aug 21 11:03:24 2022

off Data checksums

6.83 MB Cluster size

1 Databases

2 Connections

26513 Tuples returned

99% Hit cache ratio

0 Unlogged tables

0 Invalid indexes

0 Hash indexes

0 Deadlocks

2022-08-20 10:50:02-05 Last bgwriter stats reset
Databases
6.83 MB Largest database
(postgres)

2 Most connections
(postgres)

26513 Most tuples returned
(postgres)

99% Worst cache utilization
(postgres)

1 Extensions (plpgsql-1.0)
System
Sun Aug 21 11:02:24 2022 to Sun Aug 21 11:03:24 2022

54.45% Highest CPU utilization
(Sun Aug 21 11:02:24 2022)

0.00 Highest system load
(Sun Aug 21 11:02:24 2022)

0 Highest blocked processes
(Sun Aug 21 11:02:24 2022)

1.33 ms Highest device wait time
(Sun Aug 21 11:03:24 2022 on device xvda)

2.75 GB Lowest system cache
(Sun Aug 21 11:02:24 2022)

236.00 KB Highest dirty memory
(Sun Aug 21 11:03:24 2022)

1.39 MB Most read device
(xvda)

0 Most written device
(xvda)

21.00 Highest tps on device
(xvda)
Archiver
0 Last archived wal
0 Last archived time
0 Last failed wal
0 Last failed time
2022-08-20 10:50:02 Last stats reset
Packages
ii postgresql 9.5+173ubuntu0.3 all object-relational SQL database (supported version) ii postgresql-9.5 9.5.25-0ubuntu0.16.04.1 amd64 object-relational SQL database, version 9.5 server ii postgresql-client-9.5 9.5.25-0ubuntu0.16.04.1 amd64 front-end programs for PostgreSQL 9.5 ii postgresql-client-common 173ubuntu0.3 all manager for multiple PostgreSQL client versions ii postgresql-common 173ubuntu0.3 all PostgreSQL database-cluster manager ii postgresql-contrib 9.5+173ubuntu0.3 all additional facilities for PostgreSQL (supported version) ii postgresql-contrib-9.5 9.5.25-0ubuntu0.16.04.1 amd64 additional facilities for PostgreSQL
About pgCluu

pgCluu is a Perl program used to perform a full audit of a PostgreSQL Cluster. It is divided in two parts, a collector used to grab statistics on the PostgreSQL cluster using psql and sysstat, a grapher that will generate all HTML output. It is fully open source and free of charge.

License

pgCluu is licenced under the PostgreSQL Licence a liberal Open Source license, similar to the BSD or MIT licenses.

That mean that all parts of the program are open source and free of charge.

This is the case for both, the collector and the grapher programs.

Download

Official releases at SourceForge:
[ http://sourceforge.net/projects/pgcluu/ ].

Source code at github:
[ https://github.com/darold/pgcluu ].

ChangeLog can be read on-line on GitHub repository here
Offical web site is hosted at pgcluu.darold.net

Authors

pgCluu is an original development of Gilles Darold.

Some parts of the collector are taken from pgstats a C program writen by Guillaume Lelarge and especially the SQL queries including the compatibility with all PostgreSQL versions.

Btw pgCluu grapher is compatible with files generated by pgstats, sar and sadc so you can use it independently to graph those data. Some part of the sar output parser are taken from SysUsage

System

OS information

11:03:24 up 86 days Uptime
ip-172-31-17-251 Hostname
Linux 4.4.0-1128-aws #142-Ubuntu SMP Kernel
x86_64 GNU/Linux Arch
Ubuntu Distribution
16.04.6 LTS (Xenial Xerus) Version

Kernel

/sys/kernel/mm/transparent_hugepage/

defrag always
enabled madvise
khugepaged/defrag 1

sysctl parameters

sched_autogroup_enabled 1
sched_migration_cost_ns 500000
net.ipv4.tcp_keepalive_intvl 75
net.ipv4.tcp_keepalive_probes 9
net.ipv4.tcp_keepalive_time 7200
vm.dirty_background_bytes 0
vm.dirty_background_ratio 10
vm.dirty_bytes 0
vm.dirty_ratio 20
vm.nr_hugepages 0
vm.nr_overcommit_hugepages 0
vm.overcommit_kbytes 0
vm.overcommit_memory 0
vm.overcommit_ratio 50
vm.swappiness 60
vm.zone_reclaim_mode 0

CPU

CPUs information

Intel(R) Xeon(R) CPU E5-2686 v4
2300.066 Speed
46080 KB Cache
1 Sockets
2 Cores per CPU
2 Cores

Memory

Memory information

3.77 GB Total memory
229.50 MB Free memory
355.98 MB Buffers
2.68 GB Cached
0 Total swap
0 Free swap
9.39 MB Page Tables
52.82 MB Shared memory

sysctl parameters

16384.00 PB kernel.shmmax
67108864.00 PB kernel.shmall

Filesystem

Filesystem Size Used Free Use% Mount

/dev/xvda1 49G 7.7G 41G 16% /
Filesystem Mount type Options

/dev/xvda1 / ext4 (rw,relatime,discard,data=ordered) [cloudimg-rootfs]

Filesystem	Size	Used	Free	Use%	Mount
/dev/xvda1	49G	7.7G	41G	16%	/

Filesystem	Mount	type	Options
/dev/xvda1	/	ext4	(rw,relatime,discard,data=ordered)	[cloudimg-rootfs]

Process list

USER	PID	%CPU	%MEM	VSZ	RSS	TTY	STAT	START	TIME	COMMAND
root	2	0.0	0.0	0	0	?	S	May26	0:00	[kthreadd]
root	3	0.0	0.0	0	0	?	S	May26	0:18	\_ [ksoftirqd/0]
root	5	0.0	0.0	0	0	?	S<	May26	0:00	\_ [kworker/0:0H]
root	7	0.0	0.0	0	0	?	S	May26	2:57	\_ [rcu_sched]
root	8	0.0	0.0	0	0	?	S	May26	0:00	\_ [rcu_bh]
root	9	0.0	0.0	0	0	?	S	May26	0:03	\_ [migration/0]
root	10	0.0	0.0	0	0	?	S	May26	0:37	\_ [watchdog/0]
root	11	0.0	0.0	0	0	?	S	May26	0:29	\_ [watchdog/1]
root	12	0.0	0.0	0	0	?	S	May26	0:02	\_ [migration/1]
root	13	0.0	0.0	0	0	?	S	May26	0:46	\_ [ksoftirqd/1]
root	15	0.0	0.0	0	0	?	S<	May26	0:00	\_ [kworker/1:0H]
root	16	0.0	0.0	0	0	?	S	May26	0:00	\_ [kdevtmpfs]
root	17	0.0	0.0	0	0	?	S<	May26	0:00	\_ [netns]
root	18	0.0	0.0	0	0	?	S<	May26	0:00	\_ [perf]
root	19	0.0	0.0	0	0	?	S	May26	0:00	\_ [xenwatch]
root	20	0.0	0.0	0	0	?	S	May26	0:00	\_ [xenbus]
root	22	0.0	0.0	0	0	?	S	May26	0:03	\_ [khungtaskd]
root	23	0.0	0.0	0	0	?	S<	May26	0:00	\_ [writeback]
root	24	0.0	0.0	0	0	?	SN	May26	0:00	\_ [ksmd]
root	25	0.0	0.0	0	0	?	SN	May26	0:00	\_ [khugepaged]
root	26	0.0	0.0	0	0	?	S<	May26	0:00	\_ [crypto]
root	27	0.0	0.0	0	0	?	S<	May26	0:00	\_ [kintegrityd]
root	28	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	29	0.0	0.0	0	0	?	S<	May26	0:00	\_ [kblockd]
root	30	0.0	0.0	0	0	?	S<	May26	0:00	\_ [ata_sff]
root	31	0.0	0.0	0	0	?	S<	May26	0:00	\_ [md]
root	32	0.0	0.0	0	0	?	S<	May26	0:00	\_ [devfreq_wq]
root	36	0.0	0.0	0	0	?	S	May26	0:00	\_ [kswapd0]
root	37	0.0	0.0	0	0	?	S<	May26	0:00	\_ [vmstat]
root	38	0.0	0.0	0	0	?	S	May26	0:00	\_ [fsnotify_mark]
root	39	0.0	0.0	0	0	?	S	May26	0:00	\_ [ecryptfs-kthrea]
root	55	0.0	0.0	0	0	?	S<	May26	0:00	\_ [kthrotld]
root	56	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	57	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	58	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	59	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	60	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	61	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	62	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	63	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	64	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	65	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	66	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	67	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	68	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	69	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	70	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	71	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	72	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	73	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	74	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	75	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	76	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	77	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	78	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	79	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	80	0.0	0.0	0	0	?	S<	May26	0:00	\_ [nvme]
root	81	0.0	0.0	0	0	?	S	May26	0:00	\_ [scsi_eh_0]
root	82	0.0	0.0	0	0	?	S<	May26	0:00	\_ [scsi_tmf_0]
root	83	0.0	0.0	0	0	?	S	May26	0:00	\_ [scsi_eh_1]
root	84	0.0	0.0	0	0	?	S<	May26	0:00	\_ [scsi_tmf_1]
root	85	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	90	0.0	0.0	0	0	?	S<	May26	0:00	\_ [ipv6_addrconf]
root	103	0.0	0.0	0	0	?	S<	May26	0:00	\_ [deferwq]
root	255	0.0	0.0	0	0	?	S<	May26	0:00	\_ [raid5wq]
root	280	0.0	0.0	0	0	?	S<	May26	0:00	\_ [bioset]
root	311	0.0	0.0	0	0	?	S	May26	0:30	\_ [jbd2/xvda1-8]
root	312	0.0	0.0	0	0	?	S<	May26	0:00	\_ [ext4-rsv-conver]
root	374	0.0	0.0	0	0	?	S<	May26	0:00	\_ [kworker/1:1H]
root	400	0.0	0.0	0	0	?	S<	May26	0:00	\_ [iscsi_eh]
root	402	0.0	0.0	0	0	?	S<	May26	0:00	\_ [ib_addr]
root	403	0.0	0.0	0	0	?	S<	May26	0:00	\_ [ib_mcast]
root	404	0.0	0.0	0	0	?	S<	May26	0:00	\_ [ib_nl_sa_wq]
root	406	0.0	0.0	0	0	?	S<	May26	0:00	\_ [ib_cm]
root	407	0.0	0.0	0	0	?	S<	May26	0:00	\_ [iw_cm_wq]
root	411	0.0	0.0	0	0	?	S<	May26	0:00	\_ [rdma_cm]
root	412	0.0	0.0	0	0	?	S	May26	0:00	\_ [kauditd]
root	805	0.0	0.0	0	0	?	S<	May26	0:01	\_ [kworker/0:1H]
root	23494	0.0	0.0	0	0	?	S	06:59	0:00	\_ [kworker/1:0]
root	25459	0.0	0.0	0	0	?	S	10:31	0:00	\_ [kworker/0:1]
root	25460	0.0	0.0	0	0	?	S	10:31	0:00	\_ [kworker/1:1]
root	25717	0.0	0.0	0	0	?	S	10:38	0:00	\_ [kworker/0:0]
root	25794	0.0	0.0	0	0	?	S	10:42	0:00	\_ [kworker/u30:1]
root	26212	0.0	0.0	0	0	?	S	10:56	0:00	\_ [kworker/u30:2]
root	26919	0.0	0.0	0	0	?	S	11:02	0:00	\_ [kworker/u30:0]
root	1	0.0	0.1	119660	5804	?	Ss	May26	0:38	/sbin/init
root	427	0.0	0.0	94768	1624	?	Ss	May26	0:00	/sbin/lvmetad -f
root	448	0.0	0.1	12200	4776	?	Ss	May26	6:26	/usr/sbin/haveged --Foreground --verbose=1 -w 1024
root	460	0.0	0.1	40740	6104	?	Ss	May26	81:05	/lib/systemd/systemd-journald
root	463	0.0	0.0	42776	3924	?	Ss	May26	0:05	/lib/systemd/systemd-udevd
systemd+	517	0.0	0.0	100320	2328	?	Ssl	May26	0:06	/lib/systemd/systemd-timesyncd
root	962	0.0	0.0	16120	2892	?	Ss	May26	0:03	/sbin/dhclient -1 -v -pf /run/dhclient.eth0.pid -lf /var/lib/dhcp/dhclient.eth0.leases -I -df /var/lib/dhcp/dhclient6.eth0.leases eth0
root	1096	0.0	0.0	5216	144	?	Ss	May26	3:54	/sbin/iscsid
root	1097	0.0	0.0	5716	3512	?	S	May26	18:17	/sbin/iscsid
root	1101	0.0	0.0	309772	2360	?	Ssl	May26	0:44	/usr/bin/lxcfs /var/lib/lxcfs/
syslog	1103	0.0	0.1	260624	4208	?	Ssl	May26	26:14	/usr/sbin/rsyslogd -n
root	1105	0.0	0.0	4392	1316	?	Ss	May26	0:00	/usr/sbin/acpid
message+	1108	0.0	0.1	44460	5012	?	Ss	May26	0:04	/usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
daemon	1123	0.0	0.0	26040	2080	?	Ss	May26	0:00	/usr/sbin/atd -f
root	1126	0.0	0.0	27724	2740	?	Ss	May26	0:21	/usr/sbin/cron -f
root	1142	0.0	0.0	29032	3384	?	Ss	May26	0:08	/lib/systemd/systemd-logind
root	1151	0.0	0.1	274584	6244	?	Ssl	May26	8:22	/usr/lib/accountsservice/accounts-daemon
root	1191	0.0	0.1	65508	5996	?	Ss	May26	0:54	/usr/sbin/sshd -D
root	25453	0.0	0.1	92832	6944	?	Ss	10:31	0:00	\_ sshd: ubuntu [priv]
ubuntu	25527	0.0	0.0	92832	3388	?	S	10:31	0:00	\| \_ sshd: ubuntu@pts/0
ubuntu	25528	0.0	0.1	21412	5240	pts/0	Ss	10:31	0:00	\| \_ -bash
root	25541	0.0	0.0	55756	3916	pts/0	S	10:31	0:00	\| \_ sudo su
root	25542	0.0	0.0	51000	3508	pts/0	S	10:31	0:00	\| \_ su
root	25543	0.0	0.0	20120	3952	pts/0	S+	10:31	0:00	\| \_ bash
root	26127	0.0	0.1	92828	6732	?	Ss	10:55	0:00	\_ sshd: ubuntu [priv]
ubuntu	26167	0.0	0.0	92828	3424	?	S	10:55	0:00	\| \_ sshd: ubuntu@pts/2
ubuntu	26168	0.0	0.1	21412	5248	pts/2	Ss	10:55	0:00	\| \_ -bash
root	26184	0.0	0.0	55756	3920	pts/2	S	10:56	0:00	\| \_ sudo su
root	26185	0.0	0.0	51000	3580	pts/2	S	10:56	0:00	\| \_ su
root	26186	0.0	0.0	20108	3728	pts/2	S	10:56	0:00	\| \_ bash
root	26196	0.0	0.0	51000	3364	pts/2	S	10:56	0:00	\| \_ su postgres
postgres	26197	0.0	0.0	19908	3568	pts/2	S	10:56	0:00	\| \_ bash
postgres	26200	0.0	0.2	110480	8296	pts/2	S+	10:56	0:00	\| \_ /usr/lib/postgresql/9.5/bin/psql
root	26218	0.0	0.1	92828	6932	?	Ss	10:57	0:00	\_ sshd: ubuntu [priv]
ubuntu	26258	0.0	0.0	92828	3268	?	S	10:57	0:00	\| \_ sshd: ubuntu@pts/3
ubuntu	26259	0.0	0.1	21412	5188	pts/3	Ss	10:57	0:00	\| \_ -bash
root	26271	0.0	0.0	55756	3912	pts/3	S	10:57	0:00	\| \_ sudo su
root	26272	0.0	0.0	51000	3348	pts/3	S	10:57	0:00	\| \_ su
root	26273	0.0	0.0	20108	3944	pts/3	S	10:57	0:00	\| \_ bash
root	26475	0.1	0.2	28832	9580	pts/3	S+	11:02	0:00	\| \_ pgcluu_collectd
root	26928	0.0	0.1	28832	7164	pts/3	S+	11:03	0:00	\| \_ pgcluu_collectd: LC_ALL=C sar -t -p -A 1 1 \| grep -vE 'Average\|Summary' >>'/tmp/stat_pgcluu_test//sar_stats.dat'
root	26930	0.0	0.0	4500	708	pts/3	S+	11:03	0:00	\| \| \_ sh -c LC_ALL=C sar -t -p -A 1 1 \| grep -vE 'Average\|Summary' >>'/tmp/stat_pgcluu_test//sar_stats.dat'
root	26934	0.0	0.0	4464	784	pts/3	S+	11:03	0:00	\| \| \_ sar -t -p -A 1 1
root	26937	0.0	0.0	9780	1960	pts/3	S+	11:03	0:00	\| \| \| \_ sadc 1 2 -z -S 16128
root	26936	0.0	0.0	12940	928	pts/3	S+	11:03	0:00	\| \| \_ grep -vE Average\|Summary
root	26929	0.0	0.1	28832	7164	pts/3	S+	11:03	0:00	\| \_ pgcluu_collectd: LC_ALL=C pidstat -T ALL -u -w -r -d -U postgres 1 1 \| grep -v 'Average' >>'/tmp/stat_pgcluu_test//pidstat_stats.dat'
root	26931	0.0	0.0	4500	784	pts/3	S+	11:03	0:00	\| \| \_ sh -c LC_ALL=C pidstat -T ALL -u -w -r -d -U postgres 1 1 \| grep -v 'Average' >>'/tmp/stat_pgcluu_test//pidstat_stats.dat'
root	26933	0.0	0.0	4824	1780	pts/3	S+	11:03	0:00	\| \| \_ pidstat -T ALL -u -w -r -d -U postgres 1 1
root	26935	0.0	0.0	12940	1092	pts/3	S+	11:03	0:00	\| \| \_ grep -v Average
root	27045	0.0	0.0	4500	788	pts/3	S+	11:03	0:00	\| \_ sh -c ps -faux 2>/dev/null
root	27046	0.0	0.0	36224	3500	pts/3	R+	11:03	0:00	\| \_ ps -faux
root	26353	0.0	0.1	92828	6984	?	Ss	11:00	0:00	\_ sshd: ubuntu [priv]
ubuntu	26393	0.0	0.0	92828	3136	?	S	11:00	0:00	\_ sshd: ubuntu@pts/4
ubuntu	26394	0.0	0.1	21412	5184	pts/4	Ss	11:00	0:00	\_ -bash
root	26406	0.0	0.0	55756	3924	pts/4	S	11:00	0:00	\_ sudo su
root	26407	0.0	0.0	51000	3364	pts/4	S	11:00	0:00	\_ su
root	26408	0.0	0.0	20108	3868	pts/4	S+	11:00	0:00	\_ bash
root	1192	0.0	0.0	13368	164	?	Ss	May26	0:00	/sbin/mdadm --monitor --pid-file /run/mdadm/monitor.pid --daemonise --scan --syslog
root	1200	0.0	0.4	173336	19820	?	Ssl	May26	0:00	/usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root	1208	0.0	0.1	277108	5700	?	Ssl	May26	0:01	/usr/lib/policykit-1/polkitd --no-debug
root	1263	0.0	0.0	14652	1536	tty1	Ss+	May26	0:00	/sbin/agetty --noclear tty1 linux
root	1284	0.0	0.0	19468	248	?	Ss	May26	4:29	/usr/sbin/irqbalance --pid=/var/run/irqbalance.pid
root	1296	0.0	0.0	14468	1924	ttyS0	Ss+	May26	0:00	/sbin/agetty --keep-baud 115200 38400 9600 ttyS0 vt220
cgarcia	17864	0.0	0.1	45184	4512	?	Ss	May31	0:00	/lib/systemd/systemd --user
cgarcia	17866	0.0	0.0	61256	1884	?	S	May31	0:00	\_ (sd-pam)
root	5827	0.0	0.0	6532	680	?	S	Jul01	0:37	ping -i20 10.212.241.177
root	621	0.0	0.0	15224	1664	?	Ss	Jul04	0:00	/usr/lib/ipsec/starter --daemon charon
root	622	0.0	0.4	1510940	18772	?	Ssl	Jul04	8:56	\_ /usr/lib/ipsec/charon --use-syslog --debug-ike 4 --debug-knl 2 --debug-cfg 2 --debug-net 4 --debug-esp 2 --debug-dmn 2 --debug-mgr 2
postgres	8470	0.0	0.6	293412	24416	?	S	Aug20	0:01	/usr/lib/postgresql/9.5/bin/postgres -D /var/lib/postgresql/9.5/main -c config_file=/etc/postgresql/9.5/main/postgresql.conf
postgres	8472	0.0	0.1	293544	7444	?	Ss	Aug20	0:00	\_ postgres: checkpointer process
postgres	8473	0.0	0.1	293412	5668	?	Ss	Aug20	0:00	\_ postgres: writer process
postgres	8474	0.0	0.1	293412	4068	?	Ss	Aug20	0:00	\_ postgres: wal writer process
postgres	8475	0.0	0.1	293796	6744	?	Ss	Aug20	0:00	\_ postgres: autovacuum launcher process
postgres	8476	0.0	0.1	148524	4272	?	Ss	Aug20	0:00	\_ postgres: stats collector process
postgres	26208	0.0	0.3	300696	14012	?	Ss	10:56	0:00	\_ postgres: postgres postgres [local] idle
root	11981	0.0	0.1	75812	4868	?	Ss	Aug20	0:03	/usr/sbin/apache2 -k start
www-data	11984	0.0	0.1	1282864	7184	?	Sl	Aug20	0:39	\_ /usr/sbin/apache2 -k start
www-data	11985	0.0	0.1	1282896	7144	?	Sl	Aug20	0:39	\_ /usr/sbin/apache2 -k start
ubuntu	25457	0.0	0.1	45184	4544	?	Ss	10:31	0:00	/lib/systemd/systemd --user
ubuntu	25458	0.0	0.0	143112	1896	?	S	10:31	0:00	\_ (sd-pam)

Cluster

Databases

System

Archiver

Packages

About pgCluu

License

Download

Authors

System

Kernel

CPU

Memory

Filesystem

Process list