
start of application (1 OMP threads)...
2018-10-23 15:00:24.157

Problem setup...
Setup time: 0.561497 sec 

GPU: 'Tesla K40m' 
Memory use: 8056 MB / 11441 MB
2x1x1 process grid
256x256x256 local domain

Reference SpMV+MG...

Reference CG...
Initial Residual: 7.303536e+03 Max_err: 1.000000e+00 tot_err: 5.792619e+03
REF  Iter = 1 Scaled Residual: 1.875554e-01 Max error: 1.000000e+00 tot_error: 9.748362e-01 
REF  Iter = 2 Scaled Residual: 1.031535e-01 Max error: 1.000000e+00 tot_error: 9.515092e-01 
REF  Iter = 3 Scaled Residual: 7.120013e-02 Max error: 1.000000e+00 tot_error: 9.286195e-01 
REF  Iter = 4 Scaled Residual: 5.436101e-02 Max error: 1.000000e+00 tot_error: 9.059291e-01 
REF  Iter = 5 Scaled Residual: 4.391611e-02 Max error: 1.000000e+00 tot_error: 8.833819e-01 
REF  Iter = 6 Scaled Residual: 3.680132e-02 Max error: 1.000000e+00 tot_error: 8.609699e-01 
REF  Iter = 7 Scaled Residual: 3.165293e-02 Max error: 1.000000e+00 tot_error: 8.386906e-01 
REF  Iter = 8 Scaled Residual: 2.777090e-02 Max error: 1.000000e+00 tot_error: 8.165504e-01 
REF  Iter = 9 Scaled Residual: 2.475107e-02 Max error: 1.000000e+00 tot_error: 7.945543e-01 
REF  Iter = 10 Scaled Residual: 2.233599e-02 Max error: 1.000000e+00 tot_error: 7.727078e-01 
REF  Iter = 11 Scaled Residual: 2.035241e-02 Max error: 1.000000e+00 tot_error: 7.510112e-01 
REF  Iter = 12 Scaled Residual: 1.868125e-02 Max error: 1.000000e+00 tot_error: 7.294629e-01 
REF  Iter = 13 Scaled Residual: 1.724083e-02 Max error: 1.000000e+00 tot_error: 7.080589e-01 
REF  Iter = 14 Scaled Residual: 1.598088e-02 Max error: 9.999999e-01 tot_error: 6.867954e-01 
REF  Iter = 15 Scaled Residual: 1.487194e-02 Max error: 9.999999e-01 tot_error: 6.656721e-01 
REF  Iter = 16 Scaled Residual: 1.389510e-02 Max error: 9.999999e-01 tot_error: 6.446910e-01 
REF  Iter = 17 Scaled Residual: 1.303676e-02 Max error: 9.999998e-01 tot_error: 6.238569e-01 
REF  Iter = 18 Scaled Residual: 1.228318e-02 Max error: 9.999996e-01 tot_error: 6.031754e-01 
REF  Iter = 19 Scaled Residual: 1.161770e-02 Max error: 9.999994e-01 tot_error: 5.826507e-01 
REF  Iter = 20 Scaled Residual: 1.102305e-02 Max error: 9.999990e-01 tot_error: 5.622831e-01 
REF  Iter = 21 Scaled Residual: 1.048220e-02 Max error: 9.999983e-01 tot_error: 5.420704e-01 
REF  Iter = 22 Scaled Residual: 9.981183e-03 Max error: 9.999972e-01 tot_error: 5.220064e-01 
REF  Iter = 23 Scaled Residual: 9.512729e-03 Max error: 9.999952e-01 tot_error: 5.020846e-01 
REF  Iter = 24 Scaled Residual: 9.075577e-03 Max error: 9.999915e-01 tot_error: 4.822996e-01 
REF  Iter = 25 Scaled Residual: 8.671383e-03 Max error: 9.999847e-01 tot_error: 4.626489e-01 
REF  Iter = 26 Scaled Residual: 8.303370e-03 Max error: 9.999718e-01 tot_error: 4.431313e-01 
REF  Iter = 27 Scaled Residual: 7.972328e-03 Max error: 9.999467e-01 tot_error: 4.237479e-01 
REF  Iter = 28 Scaled Residual: 7.675332e-03 Max error: 9.998970e-01 tot_error: 4.044962e-01 
REF  Iter = 29 Scaled Residual: 7.406349e-03 Max error: 9.997964e-01 tot_error: 3.853712e-01 
REF  Iter = 30 Scaled Residual: 7.157473e-03 Max error: 9.995889e-01 tot_error: 3.663605e-01 
REF  Iter = 31 Scaled Residual: 6.921875e-03 Max error: 9.991558e-01 tot_error: 3.474431e-01 
REF  Iter = 32 Scaled Residual: 6.700706e-03 Max error: 9.982463e-01 tot_error: 3.285775e-01 
REF  Iter = 33 Scaled Residual: 6.509625e-03 Max error: 9.963389e-01 tot_error: 3.096707e-01 
REF  Iter = 34 Scaled Residual: 6.396491e-03 Max error: 9.923658e-01 tot_error: 2.904667e-01 
REF  Iter = 35 Scaled Residual: 6.469459e-03 Max error: 9.841201e-01 tot_error: 2.702774e-01 
REF  Iter = 36 Scaled Residual: 6.907188e-03 Max error: 9.668068e-01 tot_error: 2.474507e-01 
REF  Iter = 37 Scaled Residual: 7.801895e-03 Max error: 9.298522e-01 tot_error: 2.189607e-01 
REF  Iter = 38 Scaled Residual: 8.522993e-03 Max error: 8.564455e-01 tot_error: 1.831114e-01 
REF  Iter = 39 Scaled Residual: 7.517045e-03 Max error: 7.496148e-01 tot_error: 1.490081e-01 
REF  Iter = 40 Scaled Residual: 5.286336e-03 Max error: 6.513882e-01 tot_error: 1.290773e-01 
REF  Iter = 41 Scaled Residual: 4.126503e-03 Max error: 5.725595e-01 tot_error: 1.187522e-01 
REF  Iter = 42 Scaled Residual: 4.244509e-03 Max error: 4.914479e-01 tot_error: 1.096968e-01 
REF  Iter = 43 Scaled Residual: 3.922996e-03 Max error: 4.462627e-01 tot_error: 1.001558e-01 
REF  Iter = 44 Scaled Residual: 3.329863e-03 Max error: 3.959649e-01 tot_error: 9.277680e-02 
REF  Iter = 45 Scaled Residual: 3.121655e-03 Max error: 3.402817e-01 tot_error: 8.642115e-02 
REF  Iter = 46 Scaled Residual: 2.845085e-03 Max error: 3.141888e-01 tot_error: 8.071417e-02 
REF  Iter = 47 Scaled Residual: 2.663187e-03 Max error: 2.883054e-01 tot_error: 7.541744e-02 
REF  Iter = 48 Scaled Residual: 2.313259e-03 Max error: 2.541708e-01 tot_error: 7.096871e-02 
REF  Iter = 49 Scaled Residual: 2.314809e-03 Max error: 2.240125e-01 tot_error: 6.663275e-02 
REF  Iter = 50 Scaled Residual: 1.893151e-03 Max error: 2.011743e-01 tot_error: 6.290358e-02 

Optimization...
Optimization time: 4.832498e-01 sec 

Validation...

Optimized CG Setup...
Initial Residual: 7.303536e+03 Max_err: 1.000000e+00 tot_err: 5.792619e+03
Iteration = 1 Scaled Residual: 2.202355e-01 Max error: 1.000000e+00 tot_error: 9.747062e-01 
Iteration = 2 Scaled Residual: 1.191408e-01 Max error: 1.000000e+00 tot_error: 9.509981e-01 
Iteration = 3 Scaled Residual: 8.101976e-02 Max error: 1.000000e+00 tot_error: 9.278474e-01 
Iteration = 4 Scaled Residual: 6.133038e-02 Max error: 1.000000e+00 tot_error: 9.049772e-01 
Iteration = 5 Scaled Residual: 4.937260e-02 Max error: 1.000000e+00 tot_error: 8.822573e-01 
Iteration = 6 Scaled Residual: 4.129935e-02 Max error: 1.000000e+00 tot_error: 8.596760e-01 
Iteration = 7 Scaled Residual: 3.549219e-02 Max error: 1.000000e+00 tot_error: 8.372146e-01 
Iteration = 8 Scaled Residual: 3.111582e-02 Max error: 1.000000e+00 tot_error: 8.148798e-01 
Iteration = 9 Scaled Residual: 2.768737e-02 Max error: 1.000000e+00 tot_error: 7.926732e-01 
Iteration = 10 Scaled Residual: 2.493183e-02 Max error: 1.000000e+00 tot_error: 7.706043e-01 
Iteration = 11 Scaled Residual: 2.266816e-02 Max error: 1.000000e+00 tot_error: 7.486711e-01 
Iteration = 12 Scaled Residual: 2.077078e-02 Max error: 1.000000e+00 tot_error: 7.268817e-01 
Iteration = 13 Scaled Residual: 1.916070e-02 Max error: 1.000000e+00 tot_error: 7.052362e-01 
Iteration = 14 Scaled Residual: 1.777545e-02 Max error: 1.000000e+00 tot_error: 6.837382e-01 
Iteration = 15 Scaled Residual: 1.656967e-02 Max error: 1.000000e+00 tot_error: 6.623892e-01 
Iteration = 16 Scaled Residual: 1.551185e-02 Max error: 9.999999e-01 tot_error: 6.411936e-01 
Iteration = 17 Scaled Residual: 1.457590e-02 Max error: 9.999998e-01 tot_error: 6.201493e-01 
Iteration = 18 Scaled Residual: 1.374247e-02 Max error: 9.999995e-01 tot_error: 5.992607e-01 
Iteration = 19 Scaled Residual: 1.299607e-02 Max error: 9.999989e-01 tot_error: 5.785266e-01 
Iteration = 20 Scaled Residual: 1.232356e-02 Max error: 9.999975e-01 tot_error: 5.579493e-01 
Iteration = 21 Scaled Residual: 1.171536e-02 Max error: 9.999947e-01 tot_error: 5.375272e-01 
Iteration = 22 Scaled Residual: 1.116264e-02 Max error: 9.999887e-01 tot_error: 5.172633e-01 
Iteration = 23 Scaled Residual: 1.065844e-02 Max error: 9.999766e-01 tot_error: 4.971523e-01 
Iteration = 24 Scaled Residual: 1.019609e-02 Max error: 9.999525e-01 tot_error: 4.771967e-01 
Iteration = 25 Scaled Residual: 9.769197e-03 Max error: 9.999053e-01 tot_error: 4.573903e-01 
Iteration = 26 Scaled Residual: 9.372635e-03 Max error: 9.998147e-01 tot_error: 4.377313e-01 
Iteration = 27 Scaled Residual: 9.001771e-03 Max error: 9.996442e-01 tot_error: 4.182106e-01 
Iteration = 28 Scaled Residual: 8.651888e-03 Max error: 9.993298e-01 tot_error: 3.988218e-01 
Iteration = 29 Scaled Residual: 8.321155e-03 Max error: 9.987606e-01 tot_error: 3.795448e-01 
Iteration = 30 Scaled Residual: 8.008973e-03 Max error: 9.977499e-01 tot_error: 3.603581e-01 
Iteration = 31 Scaled Residual: 7.720291e-03 Max error: 9.959879e-01 tot_error: 3.412080e-01 
Iteration = 32 Scaled Residual: 7.467830e-03 Max error: 9.929689e-01 tot_error: 3.220007e-01 
Iteration = 33 Scaled Residual: 7.276368e-03 Max error: 9.878719e-01 tot_error: 3.025403e-01 
Iteration = 34 Scaled Residual: 7.186086e-03 Max error: 9.793485e-01 tot_error: 2.824624e-01 
Iteration = 35 Scaled Residual: 7.252271e-03 Max error: 9.651324e-01 tot_error: 2.611166e-01 
Iteration = 36 Scaled Residual: 7.518755e-03 Max error: 9.413592e-01 tot_error: 2.375093e-01 
Iteration = 37 Scaled Residual: 7.946852e-03 Max error: 9.018159e-01 tot_error: 2.105169e-01 
Iteration = 38 Scaled Residual: 8.267918e-03 Max error: 8.390362e-01 tot_error: 1.801242e-01 
Iteration = 39 Scaled Residual: 7.933022e-03 Max error: 7.518796e-01 tot_error: 1.498761e-01 
Iteration = 40 Scaled Residual: 6.624575e-03 Max error: 6.561281e-01 tot_error: 1.264630e-01 
Iteration = 41 Scaled Residual: 4.932936e-03 Max error: 5.738078e-01 tot_error: 1.125693e-01 
Iteration = 42 Scaled Residual: 3.798433e-03 Max error: 5.085474e-01 tot_error: 1.047115e-01 
Iteration = 43 Scaled Residual: 3.625846e-03 Max error: 4.458959e-01 tot_error: 9.855191e-02 
Iteration = 44 Scaled Residual: 3.975714e-03 Max error: 3.957451e-01 tot_error: 9.128004e-02 
Iteration = 45 Scaled Residual: 3.601081e-03 Max error: 3.548173e-01 tot_error: 8.358086e-02 
Iteration = 46 Scaled Residual: 2.791003e-03 Max error: 3.101660e-01 tot_error: 7.825693e-02 
Iteration = 47 Scaled Residual: 2.737181e-03 Max error: 2.735203e-01 tot_error: 7.401043e-02 
Iteration = 48 Scaled Residual: 2.793836e-03 Max error: 2.484292e-01 tot_error: 6.901614e-02 
Iteration = 49 Scaled Residual: 2.207792e-03 Max error: 2.331084e-01 tot_error: 6.486940e-02 
Iteration = 50 Scaled Residual: 2.172680e-03 Max error: 2.053443e-01 tot_error: 6.153539e-02 
Iteration = 51 Scaled Residual: 2.080737e-03 Max error: 1.844315e-01 tot_error: 5.768371e-02 
Iteration = 52 Scaled Residual: 1.701928e-03 Max error: 1.689643e-01 tot_error: 5.470194e-02 

Starting Benchmarking Phase... 
Performing 7 CG sets	 expected time:   60.0 seconds	 expected Perf:      65.9 GF (33.0 GF_per)
2018-10-23 15:04:42.459
progress = 15.6% 	    9.4 /   60.0 sec elapsed 	   50.6 sec remain 	    65.921 GF 	 32.961 GF_per
progress = 31.3% 	   18.8 /   60.0 sec elapsed 	   41.2 sec remain 	    65.929 GF 	 32.965 GF_per
progress = 46.9% 	   28.1 /   60.0 sec elapsed 	   31.9 sec remain 	    65.929 GF 	 32.965 GF_per
progress = 62.5% 	   37.5 /   60.0 sec elapsed 	   22.5 sec remain 	    65.932 GF 	 32.966 GF_per
progress = 78.1% 	   46.9 /   60.0 sec elapsed 	   13.1 sec remain 	    65.929 GF 	 32.965 GF_per
progress = 93.8% 	   56.3 /   60.0 sec elapsed 	    3.7 sec remain 	    65.930 GF 	 32.965 GF_per

Completed Benchmarking Phase... elapsed time:   65.6 seconds 
2018-10-23 15:05:48.108

Number of CG sets:	7 
Iterations per set:	52 
scaled res mean:	1.701928e-03 
scaled res variance:	0.000000e+00 

Total Time: 6.564442e+01 sec 
Setup        Overhead: 0.60%
Optimization Overhead: 0.51%
Convergence  Overhead: 3.85%

2x1x1 process grid
256x256x256 local domain
SpMV  =   52.5 GF ( 330.6 GB/s Effective)   26.2 GF_per ( 165.3 GB/s Effective)
SymGS =   75.7 GF ( 584.0 GB/s Effective)   37.8 GF_per ( 292.0 GB/s Effective)
total =   69.3 GF ( 525.8 GB/s Effective)   34.7 GF_per ( 262.9 GB/s Effective)
final =   65.9 GF ( 500.0 GB/s Effective)   33.0 GF_per ( 250.0 GB/s Effective)

end of application...
2018-10-23 15:05:48.285
