Freitag, 11. August 2017

how to combine two outputs from the awk nad some another grep?


 The paste command is your friend:
paste <(cat csim.stats.txt|  grep snap  | cut -d "_" -f 6| cut -d "." -f 1 ) <(cat csim.stats.txt| grep "Type=           5" |  awk '{n+=$4;printf"%s %s\n",$4,n }') >snap2part.txt

Montag, 31. Juli 2017

After upgrade Ovirt 4.1.3 to 4.1.4 failing to start or migrate the virtual machines


 After upgrade Ovirt 4.1.3 to 4.1.4 it was failing to start  or migrate the virtual machines
 General command validation failure

2017-07-31 17:25:38,078+02 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (default task-497) [949b0e76-a2a9-4978-9879-9d38fc12b77c] Error during ValidateFailure.: java.lang.NullPointerException

the server.log was logging following errors as well:
2017-07-31 17:28:16,228+02 INFO  [org.quartz.core.JobRunShell] (DefaultQuartzScheduler8) Job DEFAULT.org.ovirt.engine.core.bll.scheduling.SchedulingManager.performLoadBalancing#-9223372036854775697 threw a JobExecutionException: : org.quartz.JobExecutionException: failed to execute job
    at sun.reflect.GeneratedMethodAccessor259.invoke(Unknown Source) [:1.8.0_141]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_141]
    at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_141]
    at org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:83) [scheduler.jar:]
    at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:55) [scheduler.jar:]
    at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_141]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_141]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_141]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_141]
    at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_141]

To fix:

It is turning out that upgrade process was resetting the Scheduling Policy to NULL or none.
 
Edit Cluster->Scheduling Policy-> Select Policy: vm_evently_distributed

Freitag, 30. Juni 2017

NextCloud: What are you doing with my storage?

In order to audit it we should install on the debian auditd package:
apt install auditd
Start auditing:
auditctl -w /DATA/
Stop auditing
auditctl -W /DATA/
Monitoring:
tail /var/log/audit/audit.log  -f 

I just wondering if some one has similar numbers on the nextcloud?

The setup is quite simple:)
1) debian 9
2) mariadb with storage on /dev/shm
3) storage is NFS over 10G with 2Intel NVMe PCIe striped with ZFS

benchmark windows client trying to upload:
  1. gcc-7-sourcecode - 1x
  2. kernel4-sourcecode - 3x
  3. kernel3-sourcecode - 1x
  4. boost-1-64-src         - 1x 
Totally 331K files with about 6GB
The mariadb shows around 5K queries/second, is someone got better numbers?



NextCloud check database tables size

If you need to know how much storage you consume with you NextCloud instance you can run following command on the database:

SELECT       table_schema as `Database`,       table_name AS `Table`,       round(((data_length + index_length) / 1024 / 1024), 2) `Size in MB`  FROM information_schema.TABLES where table_name LIKE 'oc_%' ORDER BY (data_length + index_length);
credits goes to stackoverflow:
https://stackoverflow.com/questions/9620198/how-to-get-the-sizes-of-the-tables-of-a-mysql-database

Freitag, 23. Juni 2017

Torque PBS queue: sending mails.

It is important to configure torque jobqueue server with following parameter:

qmgr -c 'set server mail_from = adm@mail.domain'
qmgr -c 'set server mail_domain = my.pbsserver.host'
qmgr -c 'set server mail_subject_fmt = [NO-REPLY]Cluster Muster: Job %i - %r
'


How to fix owncloud client: No Icons in Finder on MacOS


One should enable Finder extension for the ownCloud client:
left upper Apple icon->System Preferences -> Extensions and enable owncloud for Finder